-- Logs begin at Mon 2022-09-19 14:11:26 UTC, end at Mon 2022-09-19 15:09:13 UTC. -- Sep 19 14:43:46.653339 dv-cinder-756709-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:43:46 2022] *** Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: nodename: dv-cinder-756709-7-iscsi Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: machine: x86_64 Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: clock source: unix Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: pcre jit disabled Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: detected number of CPU cores: 4 Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: current working directory: / Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: your processes number limit is 47680 Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: your memory page size is 4096 bytes Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: detected max file descriptor number: 2048 Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: lock engine: pthread robust mutexes Sep 19 14:43:46.664238 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: thunder lock: enabled Sep 19 14:43:46.665675 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 14:43:46.665675 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:43:46.704508 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: Python main interpreter initialized at 0x55fe051b79c0 Sep 19 14:43:46.704508 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: python threads support enabled Sep 19 14:43:46.704508 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: your server socket listen backlog is limited to 100 connections Sep 19 14:43:46.704508 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:43:46.704884 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:43:46.704969 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: *** Operational MODE: preforking *** Sep 19 14:43:46.705183 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:43:46.705183 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: spawned uWSGI master process (pid: 111872) Sep 19 14:43:46.705382 dv-cinder-756709-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 14:43:46.706083 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: spawned uWSGI worker 1 (pid: 111873, cores: 1) Sep 19 14:43:46.707322 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: spawned uWSGI worker 2 (pid: 111874, cores: 1) Sep 19 14:43:46.707322 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:43:47.361768 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:43:47.373837 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:43:48.447218 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:43:48.447218 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: from cryptography.utils import int_from_bytes Sep 19 14:43:48.447981 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:43:48.447981 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: from cryptography.utils import int_from_bytes Sep 19 14:43:48.452810 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:43:48.452810 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: from cryptography.utils import int_from_bytes Sep 19 14:43:48.453277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:43:48.453277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: from cryptography.utils import int_from_bytes Sep 19 14:43:50.913494 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:43:50.914108 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:43:50.914273 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:43:50.914633 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:43:50.914882 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:43:50.915266 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.915585 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.915926 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.916242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.916569 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.916659 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:43:50.917024 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.917109 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:43:50.917199 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.917419 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:43:50.917509 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.917783 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.917870 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:43:50.918039 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.918143 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:43:50.918349 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.918446 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.918667 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-7-iscsi {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.918762 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.918983 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.919103 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.919290 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.919435 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.919595 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.919726 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.919934 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920081 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920238 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920376 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920555 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920686 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920858 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.920990 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.921137 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.921360 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.922613 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.922613 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-7-iscsi {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.922879 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923007 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923141 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923268 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923403 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923539 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923669 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923796 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.923947 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924073 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924198 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924347 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924482 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924609 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924736 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924736 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.924985 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925145 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925282 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925408 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-7-iscsi {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925542 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925669 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925795 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.925920 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926064 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926197 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926336 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926470 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926597 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926723 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926845 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.926983 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927111 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927236 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927363 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927488 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927623 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927773 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.927935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-7-iscsi {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.928331 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.928460 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.928597 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.928732 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.928867 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.929002 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.929142 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.929385 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.929537 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.929727 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.929870 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930029 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930171 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930344 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930482 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930646 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930778 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.930946 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931078 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931211 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931338 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931489 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931619 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931806 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.931978 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932145 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932276 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932465 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932613 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932748 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932877 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.932986 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.933122 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.933249 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.933548 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.933838 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.933973 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934144 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934273 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934449 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934594 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934721 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934854 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.934982 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.935108 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.935310 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.935441 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.935615 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.935750 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.935940 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936087 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936301 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936440 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936586 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936715 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936841 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.936976 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937103 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937245 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937385 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937512 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937645 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937827 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.937960 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.938086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.938255 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.938397 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.938564 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.938704 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.938872 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.939009 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.939183 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.939322 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.939493 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.939632 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.939849 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940017 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940146 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940272 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940464 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940596 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940764 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.940892 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941080 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941210 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941552 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941722 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941853 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.941979 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942105 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942243 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942371 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942537 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942674 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942850 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.942979 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.943154 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.943285 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.943458 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.943588 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.943759 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.943969 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944111 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944249 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944383 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944515 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944652 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944789 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.944916 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.945651 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.945794 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.945960 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946091 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946226 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946354 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946503 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946633 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946810 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.946940 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.947131 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.947268 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.947430 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.947557 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.947739 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.947887 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948072 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948205 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948377 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948508 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948674 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948819 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.948978 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.949110 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.949279 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.949410 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.949584 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.949725 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.949885 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950015 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950185 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950316 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950488 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950635 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950788 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.950919 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.951089 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.951226 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.951390 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.951529 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.951692 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.951842 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952019 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952150 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952334 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952475 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952630 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952768 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.952913 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953042 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953225 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953368 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953523 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953652 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953823 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.953954 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.954121 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.954261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.954420 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.954552 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.954719 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.954867 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955003 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955141 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955302 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955433 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955602 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955744 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.955925 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956055 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956223 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956362 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956536 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956666 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956840 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.956977 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.957142 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.957274 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.957443 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.957582 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.957756 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.957896 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.958060 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.958190 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.958369 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.958507 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.958677 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.958818 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.958988 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.959118 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.959295 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.959446 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.959593 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.959720 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.959914 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.960047 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.960240 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.960390 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.960556 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.960706 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.961438 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.961572 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.961756 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.961901 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.962067 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.962206 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.962391 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:43:50.962535 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.962703 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.962842 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963020 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963151 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963345 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963487 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963691 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963843 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.963973 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.964100 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.964280 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.964411 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.964587 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.964719 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.964899 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965040 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965223 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965353 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965539 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965672 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965845 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.965983 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.966165 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.966302 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.966481 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.966618 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.966800 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.966930 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.967116 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.967245 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.967434 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.967566 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.967743 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.967905 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.968089 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.968218 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.968394 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.968531 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.968713 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.968851 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969021 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969159 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969329 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969468 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969644 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969776 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.969951 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.970094 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.970269 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.970400 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.970579 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.970710 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.970886 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.971030 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.971191 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.971322 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.971504 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.971643 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.971811 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972008 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972162 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972294 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972472 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972602 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972788 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.972927 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.973099 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.973230 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.973405 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.973535 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.973718 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.973866 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974025 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974156 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974331 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974462 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974636 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974768 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.974938 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975069 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975239 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975371 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975538 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975669 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975859 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.975985 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.976164 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.976294 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.976504 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.976644 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.976827 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.976958 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.977130 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.977269 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.977456 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.977595 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.977757 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.977888 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978064 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978208 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978371 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978502 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978676 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978806 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.978975 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.979115 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.979280 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.979411 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.979582 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.979718 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.979913 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980060 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980224 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980362 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980532 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980668 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.980965 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.981151 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.981283 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.981460 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.981592 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.981762 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.981893 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982072 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982203 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982380 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982509 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982684 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982814 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.982988 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.983125 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.983290 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.983421 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.983603 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.983733 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.983933 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984064 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984241 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984390 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984556 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984686 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984864 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.984994 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.985175 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.985313 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.985487 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.985617 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.985798 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.985929 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.986186 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.986411 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.986544 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.986753 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.986889 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987016 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987143 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987265 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987356 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987438 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987578 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987888 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.987989 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.988189 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.988280 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.988489 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.988579 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.988788 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.988912 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.989089 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.989220 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.989386 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.989549 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.989702 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.989879 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990006 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990201 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990332 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990508 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990649 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990822 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.990955 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.991130 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.991261 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.991436 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.991575 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.991743 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.991908 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.992107 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.992246 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.992416 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.992550 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.992724 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.992857 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993034 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993164 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993343 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993475 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993651 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993781 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.993965 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.994094 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.994274 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.994406 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.994577 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.994706 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.994885 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995026 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995191 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995328 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995507 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995638 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995814 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.995971 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.996155 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.996316 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.996467 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.996606 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.996781 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.996921 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.997083 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.997214 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.997394 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.997524 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.997731 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.997870 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998044 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998187 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998359 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998490 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998676 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998807 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.998982 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.999112 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.999292 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.999423 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.999600 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.999731 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:50.999923 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000061 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000225 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000360 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000532 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000674 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000848 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.000979 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.001154 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.001286 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.001462 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.001593 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.001768 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.001898 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.002088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.002219 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.002395 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.002535 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.002708 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.002839 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003008 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003147 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003317 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003448 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003636 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003766 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.003976 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.004120 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.004282 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.004413 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.004589 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.004710 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.004899 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005042 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005205 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005334 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005510 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005640 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005818 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.005957 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.006120 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.006250 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.006423 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.006555 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.006730 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.006862 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.007040 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.007171 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.007346 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.007476 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.008195 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.008327 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.008495 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.008626 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.008808 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.008939 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.009113 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.009245 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.009415 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.009544 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.009718 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.009849 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010024 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010155 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010342 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010471 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010649 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010788 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.010956 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.011086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.011268 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.011407 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.011567 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.011706 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.011890 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012023 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012211 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012354 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012519 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012663 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012819 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.012957 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.013119 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.013303 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.013434 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.013570 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.013706 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.013834 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014015 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014145 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014319 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014457 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014631 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014762 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.014945 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.015075 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.015277 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.015405 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.015532 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.015658 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.015861 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016007 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016165 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016297 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016481 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016619 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016789 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.016929 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.017093 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.017225 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.017396 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.017526 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.017698 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.017836 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018004 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018142 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018310 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018441 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018625 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018765 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.018928 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019060 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019232 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019370 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019537 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019681 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019847 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.019980 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.020162 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.020294 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.020475 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.020614 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.020802 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021040 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021172 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021367 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021498 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021678 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021810 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.021997 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.022128 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.022313 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.022456 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.022632 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.022780 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.022954 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.023084 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.023310 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.023960 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.024147 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.024282 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.024464 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.024595 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.024770 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.024895 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.025073 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.025206 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.025374 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.025504 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.025680 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.025953 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.026094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.026271 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.026403 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.026571 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.026709 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.026876 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027016 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027175 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027307 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027475 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027620 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027775 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.027944 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.028086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.028214 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.028400 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.028535 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.028700 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.028830 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029006 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029138 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029305 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029437 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029622 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029762 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.029926 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030065 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030223 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030353 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030521 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030662 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030819 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.030951 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.031154 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.031285 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.031452 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.031597 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.031757 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.031904 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.032100 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.032266 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.032404 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.032541 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.032702 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.032833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033010 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033141 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033324 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033456 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033622 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033756 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.033923 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034063 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034221 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034353 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034526 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034665 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034830 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.034960 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.035125 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.035255 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.035429 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.035568 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.035735 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.035920 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036068 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036197 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036352 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036492 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036651 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036791 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.036955 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.037086 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.037253 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.037391 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.037563 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.037703 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.037868 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038009 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038169 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038300 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038468 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038607 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038772 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.038928 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.039103 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.039236 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.039439 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.039570 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.039704 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.039852 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040003 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040140 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040304 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040443 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040605 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040745 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.040903 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041035 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041202 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041334 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041506 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041646 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041810 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.041951 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.042113 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.042244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.042424 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.042553 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.042729 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.042857 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043029 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043162 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043328 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043466 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043630 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043776 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.043988 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044124 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044260 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044391 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044518 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044657 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044831 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.044972 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.045143 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.045282 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.045439 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.045578 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.045744 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.045893 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046043 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046174 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046344 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046468 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046643 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046774 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.046947 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047078 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047245 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047379 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047546 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047682 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047845 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.047979 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.048150 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.048283 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.048449 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.048586 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.048757 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.048886 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049061 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049192 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049361 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049493 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049660 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049799 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.049961 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.050092 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.050264 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.050394 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.050570 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.050710 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.050877 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051008 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051190 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051328 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051494 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051635 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051799 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.051951 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.052127 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.052257 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.052433 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.052578 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.052739 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.052878 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.053298 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.053429 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.053612 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.053752 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.053920 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.054052 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.054225 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.054355 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.054567 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.054686 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.054871 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055003 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055190 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055321 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055501 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055643 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055809 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.055964 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.056152 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.056283 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.056474 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.056606 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.056789 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.056911 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.057090 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.057219 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.057395 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.057535 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.057702 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.057834 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058007 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058147 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058312 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058444 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058618 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058749 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.058922 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.059064 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.059228 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.059357 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.059535 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.059675 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.059861 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060009 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060172 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060303 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060475 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060606 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060780 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.060920 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.061086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.061217 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.061387 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.061518 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.061703 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.061834 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062011 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062141 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062310 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062448 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062614 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062745 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.062913 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063046 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063219 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063350 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063517 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063649 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063845 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.063976 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.064162 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.064293 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.064476 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.064616 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.064786 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.064918 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.065101 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.065241 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.065412 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.065551 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.065722 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.065853 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066031 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066172 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066334 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066464 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066637 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066773 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.066973 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.067109 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.067252 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.067384 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.067562 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.067693 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.067889 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068105 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068237 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068364 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068513 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068645 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.068972 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.069132 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.069264 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.069433 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.069563 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.069730 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.069869 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071000 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071125 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071236 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071345 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071463 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071575 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071684 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071793 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.071934 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.072057 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.072177 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.072288 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.072579 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.072698 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.072883 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.073007 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.073187 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.073303 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.075535 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.075704 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.075704 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076074 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076074 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076323 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076452 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076589 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076724 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076862 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.076862 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077101 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077228 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077359 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077496 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077633 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077763 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.077899 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078029 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078156 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078283 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078410 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078538 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078674 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078812 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.078941 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079068 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079195 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079335 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079464 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079590 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079718 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079862 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.079993 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.080207 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.080345 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.080482 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.080611 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.080738 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.080873 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081004 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081140 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081269 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081397 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081524 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081652 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081792 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.081922 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082049 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082184 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082320 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082457 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082587 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082712 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082823 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.082942 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083054 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083284 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083284 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083495 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083613 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083730 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083878 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.083996 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084106 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084215 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084324 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084432 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084550 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084661 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084770 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084879 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.084988 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.085106 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.085217 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.085326 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.085443 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.085554 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.085662 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.086344 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.086464 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.086573 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.086689 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.086803 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.086911 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.087099 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.087244 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.087413 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.087530 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.087723 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.087868 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.088551 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.088685 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.088815 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.088942 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089081 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089217 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089355 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089491 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089621 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089748 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.089884 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090013 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090140 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090267 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090395 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090523 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090668 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090798 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.090925 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091059 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091195 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091331 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091469 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091606 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091747 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.091915 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092047 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092185 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092321 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092458 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092594 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092730 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.092896 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093037 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093194 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093333 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093494 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093625 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093810 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.093951 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.094110 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.094250 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.094427 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.094559 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.094731 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.094877 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095030 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095170 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095330 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095470 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095612 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095740 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.095971 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.096106 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.096273 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.096435 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.096599 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.096733 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.096904 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097035 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097218 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097348 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097529 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097679 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097832 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.097962 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.098139 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.098271 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.098446 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.098577 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.098757 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.098888 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.099059 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.099198 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.099367 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.099496 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.099671 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.099803 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100003 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100149 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100311 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100442 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100614 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100743 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.100957 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.101153 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.101287 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.101808 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.101941 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102068 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102196 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102333 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102462 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102599 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102727 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102854 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.102997 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103126 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103254 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103381 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103509 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103644 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103781 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.103928 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.104057 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.104197 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.104368 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.104500 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.104681 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.104814 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105001 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105133 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105317 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105448 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105644 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105777 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.105985 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.106187 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.106320 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.106522 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.106655 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.106842 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.106975 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.107161 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.107294 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.107502 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.107633 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.107784 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108001 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108121 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108239 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108412 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108545 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108718 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.108851 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109023 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109169 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109334 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109465 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109639 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109769 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.109943 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.110083 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.110247 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.110379 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.110555 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.110686 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.110862 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111002 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111182 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111307 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111513 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111645 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111844 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.111979 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.112156 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.112298 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.112472 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.112618 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.112783 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.112915 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.113104 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.113298 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.113431 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.113609 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.113742 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.113936 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.114067 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.114257 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.114390 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.114575 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.114715 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.114887 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115018 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115199 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115332 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115521 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115653 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115840 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.115974 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.116144 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.116293 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.116449 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.116583 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.116754 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.116893 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.117669 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.117810 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.117940 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.118067 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.118195 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.118318 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.118467 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.118612 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.118781 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.119084 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.119214 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.119443 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.119611 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.119785 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.119963 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.120144 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.120279 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.120475 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.120621 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.120799 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.120941 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.121124 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.121257 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.121456 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.121597 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.121771 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.121928 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.122081 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.122212 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.122389 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.122533 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.122701 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.122833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123004 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123144 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123305 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123438 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123604 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123736 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.123934 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.124067 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.124240 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.124373 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.124540 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.124671 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.124845 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.125072 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.125218 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.125428 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.125559 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.125740 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.125870 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126042 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126182 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126343 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126483 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126650 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126782 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.126950 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.127092 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.127250 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.127384 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.127549 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.127680 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.127866 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128002 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128175 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128307 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128476 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128609 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128781 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.128914 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.129079 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.129212 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.129384 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.129516 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.129699 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.129838 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130006 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130137 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130305 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130445 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130612 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130743 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.130911 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131049 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131210 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131356 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131522 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131654 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131839 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.131972 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.132161 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.132296 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.132470 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.132647 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.132829 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.132962 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.133139 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.133280 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.133446 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.133587 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.133760 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.133996 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.134144 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.134327 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.134469 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.134644 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.134775 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.134956 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.135095 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.135283 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.135414 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.135587 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.135719 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.135920 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.136067 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.136224 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.136357 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.136541 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.136671 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.136876 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137090 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137221 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137357 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137494 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137625 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137762 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.137898 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138026 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138161 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138312 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138456 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138617 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138751 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.138924 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.139057 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.139228 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.139512 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.139659 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.139870 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140006 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140133 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140440 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140580 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140743 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.140876 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.141052 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.141184 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.141389 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.141522 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.141700 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.141831 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142012 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142143 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142324 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142457 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142636 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142768 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.142939 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.143069 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.143245 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.143377 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.143547 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.143679 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.143867 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144019 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144181 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144313 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144492 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144623 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144802 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.144942 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.145105 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.145237 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.145419 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.145731 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.145861 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.146044 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.146177 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.146357 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.146489 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.146675 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.146815 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.147002 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.147133 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.147506 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.147689 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.147869 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.148023 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.148155 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.148803 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.148946 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.149078 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.149258 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.149403 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.149584 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.149716 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.149922 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.150052 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.150250 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.150383 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.150573 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.150704 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.150878 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.151010 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.151181 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.151314 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.151483 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.151614 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.151791 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.152134 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.152282 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.152442 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.152574 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.152745 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.152875 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153051 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153190 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153358 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153496 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153659 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153789 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.153959 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154094 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154260 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154391 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154560 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154700 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154865 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.154997 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.155165 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.155295 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.155464 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.155595 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.155763 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.155934 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.156091 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.156272 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.156414 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.156584 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.156716 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.156893 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157025 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157201 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157332 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157514 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157646 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157823 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.157954 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.158123 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.158262 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.158423 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.158564 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.158726 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.158857 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159040 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159179 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159346 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159478 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159652 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159784 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.159983 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.160129 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.160291 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.160423 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.160596 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.160734 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.160898 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161038 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161205 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161337 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161511 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161644 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161808 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.161948 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.162106 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.162230 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.162411 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.162543 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.162717 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.162848 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.163018 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.163148 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.163324 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.163468 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.163676 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.164458 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.164617 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.164749 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.164882 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165010 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165151 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165289 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165425 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165554 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165748 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.165882 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.166068 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.166201 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.166388 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.166520 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.166703 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.166913 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167098 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167237 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167367 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167495 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167622 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167759 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.167938 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.168072 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.168249 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.168382 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.168559 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.168705 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.168867 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169002 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169180 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169320 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169488 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169628 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169798 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.169938 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.170110 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.170242 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.170423 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.170555 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.170745 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.170884 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.171067 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.171200 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.171376 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.171507 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.171695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.171875 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172037 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172171 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172363 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172497 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172675 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172807 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.172987 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.173126 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.173319 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.173451 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.173629 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.173759 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.173938 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.174088 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.174240 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.174379 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.174507 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:43:51.174635 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.174849 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.175167 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.175478 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.175790 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.176133 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.176453 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.176783 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.177113 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.177428 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.177755 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.178351 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.178699 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.179015 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.179363 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.179723 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.180067 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.180382 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.180691 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:43:51.180936 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:43:51.326784 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO dbcounter [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Registered counter for database nova_api Sep 19 14:43:51.333366 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO dbcounter [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Registered counter for database nova_api Sep 19 14:43:51.348835 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_db.sqlalchemy.engines [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.356039 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writer thread running {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.357612 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_db.sqlalchemy.engines [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.364335 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writer thread running {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.412902 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.context [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fa6516d-d8a6-4e2a-89af-a6c10f9bd626(cell1) {{(pid=111873) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:43:51.416881 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_concurrency.lockutils [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.417294 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_concurrency.lockutils [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.418841 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_concurrency.lockutils [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.419568 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_concurrency.lockutils [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.420036 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_concurrency.lockutils [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.421669 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.context [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fa6516d-d8a6-4e2a-89af-a6c10f9bd626(cell1) {{(pid=111874) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:43:51.421998 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_concurrency.lockutils [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.424004 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO dbcounter [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Registered counter for database nova_cell0 Sep 19 14:43:51.425577 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.426047 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.427603 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.428247 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO dbcounter [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Registered counter for database nova_cell1 Sep 19 14:43:51.428612 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:43:51.429057 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:43:51.433641 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:43:51.436364 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO dbcounter [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Registered counter for database nova_cell0 Sep 19 14:43:51.437462 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_db.sqlalchemy.engines [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.438833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_db.sqlalchemy.engines [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.441767 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO dbcounter [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Registered counter for database nova_cell1 Sep 19 14:43:51.446491 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writer thread running {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.448021 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writer thread running {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.452819 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_db.sqlalchemy.engines [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.453578 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_db.sqlalchemy.engines [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.461298 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writer thread running {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.461633 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writer thread running {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.594912 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO dbcounter [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Registered counter for database nova_cell0 Sep 19 14:43:51.604549 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO dbcounter [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Registered counter for database nova_cell0 Sep 19 14:43:51.604760 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG oslo_db.sqlalchemy.engines [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.609218 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writer thread running {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.611585 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_db.sqlalchemy.engines [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:43:51.616330 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writer thread running {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:43:51.944581 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: WARNING keystonemiddleware.auth_token [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:43:51.948279 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: WARNING keystonemiddleware.auth_token [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:43:51.951925 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: WARNING keystonemiddleware.auth_token [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:43:51.955655 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: WARNING keystonemiddleware.auth_token [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:43:52.291555 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: WARNING keystonemiddleware.auth_token [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:43:52.297775 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: WARNING keystonemiddleware.auth_token [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:43:52.300576 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: WARNING keystonemiddleware.auth_token [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:43:52.303638 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe051b79c0 pid: 111874 (default app) Sep 19 14:43:52.306025 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:43:52.307218 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 Sep 19 14:43:52.307631 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Mon Sep 19 14:43:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:43:52.308614 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: WARNING keystonemiddleware.auth_token [None req-d62e95f2-a64a-44db-b36f-00f48f4dd858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:43:52.316909 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe051b79c0 pid: 111873 (default app) Sep 19 14:45:14.629314 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:14.630877 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Sep 19 14:45:14.631472 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:45:14.645068 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_api:SELECT=3 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:14.646722 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_cell1:SELECT=3 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:14.647901 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_cell0:SELECT=3 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:14.648962 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:15.573537 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-ff0c26e2-2994-46bf-a8e9-ffb6df3a2a3d admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:15.606527 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-ff0c26e2-2994-46bf-a8e9-ffb6df3a2a3d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.967665 Sep 19 14:45:15.607357 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Sep 19 14:45:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:18.260376 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:18.261459 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-77e62bd5-ae44-467d-8c41-9e7d03a75061 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 19 14:45:18.262165 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:18.724515 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-4abec935-1699-4397-a0fc-8cba47e25b0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:18.773215 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-4abec935-1699-4397-a0fc-8cba47e25b0e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503711 Sep 19 14:45:18.775948 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:18.788767 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_api:SELECT=3 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.789634 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_cell1:SELECT=3 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.790685 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_cell0:SELECT=3 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:18.791720 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:19.001701 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-bb066333-8baa-4038-8636-90b65746fc75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:19.071920 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-bb066333-8baa-4038-8636-90b65746fc75 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289782 Sep 19 14:45:19.072523 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Sep 19 14:45:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:45:21.707428 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-4abec935-1699-4397-a0fc-8cba47e25b0e admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:21.708424 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-4abec935-1699-4397-a0fc-8cba47e25b0e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 19 14:45:21.708997 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:22.397047 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-48e876ad-f869-4d65-8397-e3df5bfce275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "disk": 5, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:22.438884 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-48e876ad-f869-4d65-8397-e3df5bfce275 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.723399 Sep 19 14:45:22.439481 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:22.453078 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-662feb3e-63fa-4259-b83f-a618554e6415 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:22.496352 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-662feb3e-63fa-4259-b83f-a618554e6415 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047323 Sep 19 14:45:22.497086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Sep 19 14:45:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:25.094933 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-48e876ad-f869-4d65-8397-e3df5bfce275 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:25.095987 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-48e876ad-f869-4d65-8397-e3df5bfce275 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 19 14:45:25.096404 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:25.530927 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-06ccd482-e626-48ab-adaf-9bb0bc18d917 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:25.551045 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-06ccd482-e626-48ab-adaf-9bb0bc18d917 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447344 Sep 19 14:45:25.552188 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:25.564736 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-390e4fb4-7804-40e0-9d94-9848265bea8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:25.592601 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-390e4fb4-7804-40e0-9d94-9848265bea8e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031639 Sep 19 14:45:25.593181 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Sep 19 14:45:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:28.244666 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-06ccd482-e626-48ab-adaf-9bb0bc18d917 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:28.245679 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-06ccd482-e626-48ab-adaf-9bb0bc18d917 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 19 14:45:28.246080 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:28.677513 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-dccd2f43-e2cf-44fc-9082-8c964468ee61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "id": "d3"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:28.699368 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-dccd2f43-e2cf-44fc-9082-8c964468ee61 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446873 Sep 19 14:45:28.700368 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:28.712822 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-5cff6232-154b-40df-bfb5-0c78e56f9544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:28.740701 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-5cff6232-154b-40df-bfb5-0c78e56f9544 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031906 Sep 19 14:45:28.741293 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Sep 19 14:45:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:31.451681 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-dccd2f43-e2cf-44fc-9082-8c964468ee61 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:31.453100 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-dccd2f43-e2cf-44fc-9082-8c964468ee61 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Sep 19 14:45:31.453657 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:31.882316 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-46195f39-fa6b-41f5-a174-f272f50560f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "ram": 4096}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:31.909366 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-46195f39-fa6b-41f5-a174-f272f50560f4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448929 Sep 19 14:45:31.910078 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:31.924185 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-35214daa-e74e-46e8-b33e-1728ed4876ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:31.955472 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-35214daa-e74e-46e8-b33e-1728ed4876ce admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035996 Sep 19 14:45:31.956076 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1336 bytes} [Mon Sep 19 14:45:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:34.627346 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-46195f39-fa6b-41f5-a174-f272f50560f4 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:34.628404 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-46195f39-fa6b-41f5-a174-f272f50560f4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 19 14:45:34.628813 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:35.057327 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-84c937f0-2cb9-43bf-a8df-c62b12e0e84f admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:35.089655 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-84c937f0-2cb9-43bf-a8df-c62b12e0e84f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454530 Sep 19 14:45:35.090296 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Sep 19 14:45:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:45:37.913258 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-46195f39-fa6b-41f5-a174-f272f50560f4 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:37.914279 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-46195f39-fa6b-41f5-a174-f272f50560f4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 19 14:45:37.914689 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:38.323499 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-94460169-9c28-4492-b448-8a13bf36c1aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "vcpus": 1}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:38.344691 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-94460169-9c28-4492-b448-8a13bf36c1aa admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.423652 Sep 19 14:45:38.345245 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:38.358161 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-be260d0a-4c93-456a-bb8c-35348446377d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:38.387094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-be260d0a-4c93-456a-bb8c-35348446377d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032809 Sep 19 14:45:38.388247 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Sep 19 14:45:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:45:40.995813 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-94460169-9c28-4492-b448-8a13bf36c1aa admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:40.997043 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-94460169-9c28-4492-b448-8a13bf36c1aa admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Sep 19 14:45:40.997445 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:41.413005 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-bcc2dd29-b9fb-4b4a-bdef-35a3a8c7b49d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:41.433242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-bcc2dd29-b9fb-4b4a-bdef-35a3a8c7b49d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.429393 Sep 19 14:45:41.434004 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:41.446139 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-08fcfaef-f4e1-4c90-bbb9-512f10a681a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:41.470686 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-08fcfaef-f4e1-4c90-bbb9-512f10a681a7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028257 Sep 19 14:45:41.471276 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Sep 19 14:45:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:45:44.202276 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-bcc2dd29-b9fb-4b4a-bdef-35a3a8c7b49d admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:44.203303 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-bcc2dd29-b9fb-4b4a-bdef-35a3a8c7b49d admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 19 14:45:44.208142 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:44.709580 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-a3aaf5b7-4bd3-40f5-955c-f68d563d4eb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "id": "3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:44.738842 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-a3aaf5b7-4bd3-40f5-955c-f68d563d4eb4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.528835 Sep 19 14:45:44.739741 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:44.752545 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-4704e180-f768-433b-a1ae-314fc630ffbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:44.758615 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:44.787212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-4704e180-f768-433b-a1ae-314fc630ffbe admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038934 Sep 19 14:45:44.802035 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Sep 19 14:45:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:47.483943 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-a3aaf5b7-4bd3-40f5-955c-f68d563d4eb4 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:47.485128 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-a3aaf5b7-4bd3-40f5-955c-f68d563d4eb4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 Sep 19 14:45:47.485617 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:47.929999 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-6b9aeb10-02af-4040-833d-d756b634fbfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:47.951715 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-6b9aeb10-02af-4040-833d-d756b634fbfc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458833 Sep 19 14:45:47.952331 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:45:47.964650 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-daf36a59-6028-4331-9a9e-37e1a5623121 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:47.989975 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-daf36a59-6028-4331-9a9e-37e1a5623121 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028983 Sep 19 14:45:47.990560 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Sep 19 14:45:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:45:50.656431 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-6b9aeb10-02af-4040-833d-d756b634fbfc admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:45:50.657498 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-6b9aeb10-02af-4040-833d-d756b634fbfc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Sep 19 14:45:50.658381 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:45:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:45:51.101295 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-ab79da48-7a96-42d9-8400-04bcea9bee91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "vcpus": 8, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:51.107942 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:45:51.123847 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-ab79da48-7a96-42d9-8400-04bcea9bee91 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456218 Sep 19 14:45:51.132100 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1283 bytes} [Mon Sep 19 14:45:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:45:51.139284 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-b763b467-b779-4f6d-9b45-f46de0cb4026 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:45:51.169018 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-b763b467-b779-4f6d-9b45-f46de0cb4026 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035396 Sep 19 14:45:51.169607 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1333 bytes} [Mon Sep 19 14:45:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:46:08.488906 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-ab79da48-7a96-42d9-8400-04bcea9bee91 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:08.489863 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-ab79da48-7a96-42d9-8400-04bcea9bee91 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 19 14:46:08.490263 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:08.500823 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:46:08.887977 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-b6706c58-dd38-45bc-8a11-dff5abdca41a admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:08.906544 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-b6706c58-dd38-45bc-8a11-dff5abdca41a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410154 Sep 19 14:46:08.907086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Sep 19 14:46:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:46:10.234539 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-ab79da48-7a96-42d9-8400-04bcea9bee91 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.235544 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-ab79da48-7a96-42d9-8400-04bcea9bee91 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 19 14:46:10.236022 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:10.764089 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-a216bac9-3bce-424c-b0f6-be0936604a61 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.769878 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.wsgi [None req-a216bac9-3bce-424c-b0f6-be0936604a61 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-a216bac9-3bce-424c-b0f6-be0936604a61 admin admin] Request method failure captured: Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Accept: application/json Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Accept-Encoding: gzip, deflate Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Connection: keep-alive Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Content-Length: 0 Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Host: 10.222.0.60 Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Openstack-Api-Version: compute 2.92 Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Openstack-System-Scope: None Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: User-Agent: python-novaclient Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Auth-Token: gAAAAABjKICywXP6l9hnSaLkuZrBNyuMmL_3c2AKCOonyTNymYPxmdFer7gp4ruWi-tE3z8IhKBm3652t5BV25Ez9l1Tsn-z8QLnkiJy5qvaZ2kiNh9q6PvG6kgceBjis_ipqhwij70Xpt13yFxztyhaNBhWNWDPqcoeSJNri4CXrP-EQp0rkZI Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Domain-Id: None Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Domain-Name: None Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Identity-Status: Confirmed Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Is-Admin-Project: True Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Domain-Id: default Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Domain-Name: Default Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Name: admin Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Role: member,admin,reader Sep 19 14:46:10.773242 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Roles: member,admin,reader Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b206fdda52da4f339c6c008d4c7973af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant: admin Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant-Name: admin Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User: admin Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Domain-Id: default Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Domain-Name: Default Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Id: 7d770189a7bb4b81b8a42702f35fc84d Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Name: admin Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: method: > Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: exception: Flavor 42 could not be found. Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: action_args: {'id': '42'} Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:10.774980 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.776088 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.777421 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-a216bac9-3bce-424c-b0f6-be0936604a61 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:10.778689 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-a216bac9-3bce-424c-b0f6-be0936604a61 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.402127 Sep 19 14:46:10.778689 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:46:10.785866 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-9e4ce378-59e4-448e-bbd8-33ead60549fe admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.807841 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-9e4ce378-59e4-448e-bbd8-33ead60549fe admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026968 Sep 19 14:46:10.808390 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:10.818927 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-5b52e967-df09-417d-be01-eb0e39158460 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.841024 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-5b52e967-df09-417d-be01-eb0e39158460 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026607 Sep 19 14:46:10.841560 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:10.851691 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-846a0174-dec8-4966-a53d-812a446594ce admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:10.857128 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.wsgi [None req-846a0174-dec8-4966-a53d-812a446594ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-846a0174-dec8-4966-a53d-812a446594ce admin admin] Request method failure captured: Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Accept: application/json Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Accept-Encoding: gzip, deflate Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Connection: keep-alive Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Content-Length: 0 Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Host: 10.222.0.60 Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Openstack-Api-Version: compute 2.92 Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Openstack-System-Scope: None Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: User-Agent: python-novaclient Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Auth-Token: gAAAAABjKICywXP6l9hnSaLkuZrBNyuMmL_3c2AKCOonyTNymYPxmdFer7gp4ruWi-tE3z8IhKBm3652t5BV25Ez9l1Tsn-z8QLnkiJy5qvaZ2kiNh9q6PvG6kgceBjis_ipqhwij70Xpt13yFxztyhaNBhWNWDPqcoeSJNri4CXrP-EQp0rkZI Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Domain-Id: None Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Domain-Name: None Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Identity-Status: Confirmed Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Is-Admin-Project: True Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Domain-Id: default Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Domain-Name: Default Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Name: admin Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Role: member,admin,reader Sep 19 14:46:10.860461 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Roles: member,admin,reader Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b206fdda52da4f339c6c008d4c7973af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant: admin Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant-Name: admin Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User: admin Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Domain-Id: default Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Domain-Name: Default Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Id: 7d770189a7bb4b81b8a42702f35fc84d Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Name: admin Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: method: > Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: exception: Flavor 42 could not be found. Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: action_args: {'id': '42'} Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:10.861994 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.863261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:10.864689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-846a0174-dec8-4966-a53d-812a446594ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:10.865971 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-846a0174-dec8-4966-a53d-812a446594ce admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013729 Sep 19 14:46:10.865971 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Sep 19 14:46:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:46:12.077222 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-5b52e967-df09-417d-be01-eb0e39158460 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:12.078282 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-5b52e967-df09-417d-be01-eb0e39158460 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 19 14:46:12.078695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:12.620730 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-d1907cad-d794-4494-8dab-613f73930c67 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:12.625743 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.wsgi [None req-d1907cad-d794-4494-8dab-613f73930c67 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-d1907cad-d794-4494-8dab-613f73930c67 admin admin] Request method failure captured: Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Accept: application/json Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Accept-Encoding: gzip, deflate Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Connection: keep-alive Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Content-Length: 0 Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Host: 10.222.0.60 Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Openstack-Api-Version: compute 2.92 Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Openstack-System-Scope: None Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: User-Agent: python-novaclient Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Auth-Token: gAAAAABjKICzRVC749SjgPLT-etkbuahk_-p3pot6NyQOl1vQc2M6iNE-EmHz4u1qNmt0OVUrYcmGPBJFPw8E1DB4I7gp3HnovHQu3o0up-9ys6X51n3BZClqWL3DZ8TiSOojm2o4foRezPqwEu5UQ3b56FDHswaFnKX7v6AFIT19Ezv9NLmDfM Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Domain-Id: None Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Domain-Name: None Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Identity-Status: Confirmed Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Is-Admin-Project: True Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Domain-Id: default Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Domain-Name: Default Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Name: admin Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Role: member,admin,reader Sep 19 14:46:12.627244 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Roles: member,admin,reader Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b206fdda52da4f339c6c008d4c7973af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant: admin Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant-Name: admin Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User: admin Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Domain-Id: default Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Domain-Name: Default Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Id: 7d770189a7bb4b81b8a42702f35fc84d Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Name: admin Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: method: > Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: exception: Flavor 84 could not be found. Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: action_args: {'id': '84'} Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:12.628818 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:12.629820 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.631277 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-d1907cad-d794-4494-8dab-613f73930c67 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:12.632708 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-d1907cad-d794-4494-8dab-613f73930c67 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.413747 Sep 19 14:46:12.632708 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Sep 19 14:46:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:46:12.638381 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-c748bd23-2713-4f40-9549-386d13928548 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:12.653600 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-c748bd23-2713-4f40-9549-386d13928548 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018728 Sep 19 14:46:12.654147 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Sep 19 14:46:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:46:12.664187 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-54ed8778-c2df-444a-8328-91b505d22c16 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:12.680928 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-54ed8778-c2df-444a-8328-91b505d22c16 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020318 Sep 19 14:46:12.681462 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Sep 19 14:46:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:12.690610 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-669d562b-cb35-48d4-b7c6-1b45fca26574 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:12.695524 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.wsgi [None req-669d562b-cb35-48d4-b7c6-1b45fca26574 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-669d562b-cb35-48d4-b7c6-1b45fca26574 admin admin] Request method failure captured: Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Accept: application/json Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Accept-Encoding: gzip, deflate Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Connection: keep-alive Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Content-Length: 0 Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Host: 10.222.0.60 Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Openstack-Api-Version: compute 2.92 Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Openstack-System-Scope: None Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: User-Agent: python-novaclient Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Auth-Token: gAAAAABjKICzRVC749SjgPLT-etkbuahk_-p3pot6NyQOl1vQc2M6iNE-EmHz4u1qNmt0OVUrYcmGPBJFPw8E1DB4I7gp3HnovHQu3o0up-9ys6X51n3BZClqWL3DZ8TiSOojm2o4foRezPqwEu5UQ3b56FDHswaFnKX7v6AFIT19Ezv9NLmDfM Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Domain-Id: None Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Domain-Name: None Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Identity-Status: Confirmed Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Is-Admin-Project: True Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Domain-Id: default Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Domain-Name: Default Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Name: admin Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Role: member,admin,reader Sep 19 14:46:12.697056 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Roles: member,admin,reader Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b206fdda52da4f339c6c008d4c7973af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant: admin Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant-Name: admin Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User: admin Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Domain-Id: default Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Domain-Name: Default Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Id: 7d770189a7bb4b81b8a42702f35fc84d Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Name: admin Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: method: > Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: exception: Flavor 84 could not be found. Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: action_args: {'id': '84'} Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:12.698695 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:12.699696 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:12.701094 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-669d562b-cb35-48d4-b7c6-1b45fca26574 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:12.702424 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-669d562b-cb35-48d4-b7c6-1b45fca26574 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011334 Sep 19 14:46:12.702424 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Sep 19 14:46:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:46:13.919432 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-54ed8778-c2df-444a-8328-91b505d22c16 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:13.920513 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-54ed8778-c2df-444a-8328-91b505d22c16 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 19 14:46:13.920923 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:14.457827 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-615e40d0-7917-424d-9d94-1e646a28a8ab admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:14.463669 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.wsgi [None req-615e40d0-7917-424d-9d94-1e646a28a8ab admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-615e40d0-7917-424d-9d94-1e646a28a8ab admin admin] Request method failure captured: Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Accept: application/json Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Accept-Encoding: gzip, deflate Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Connection: keep-alive Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Content-Length: 0 Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Host: 10.222.0.60 Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Openstack-Api-Version: compute 2.92 Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Openstack-System-Scope: None Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: User-Agent: python-novaclient Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Auth-Token: gAAAAABjKIC13P1XR8KqNOIbJmcs1Bkaw9qGaIcWUO0AvGVXJuZVXRQOErj84nI41iK0AUAnBxmFtGlr0YJO7UhoUb5BWGos7KspHFmJOMjiZyUmE2NkCHjBYVKk57TC0i8wKeFeQs7nKOQTaWiIG6bZwJK5WRCZM64pBokpz_unhwfcqwdoeWI Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Domain-Id: None Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Domain-Name: None Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Identity-Status: Confirmed Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Is-Admin-Project: True Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Domain-Id: default Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Domain-Name: Default Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Project-Name: admin Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Role: member,admin,reader Sep 19 14:46:14.465212 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Roles: member,admin,reader Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b206fdda52da4f339c6c008d4c7973af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant: admin Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-Tenant-Name: admin Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User: admin Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Domain-Id: default Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Domain-Name: Default Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Id: 7d770189a7bb4b81b8a42702f35fc84d Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: X-User-Name: admin Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: method: > Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: exception: Flavor 451 could not be found. Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: action_args: {'id': '451'} Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:14.466833 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:14.467910 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.469254 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-615e40d0-7917-424d-9d94-1e646a28a8ab admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:14.470549 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-615e40d0-7917-424d-9d94-1e646a28a8ab admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.408604 Sep 19 14:46:14.470776 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Sep 19 14:46:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:46:14.477117 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-685e3615-3d4b-41da-af2c-b3d1a340de5b admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:14.492040 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-685e3615-3d4b-41da-af2c-b3d1a340de5b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018491 Sep 19 14:46:14.492572 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Sep 19 14:46:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:14.501967 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:14.516647 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018251 Sep 19 14:46:14.517178 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Sep 19 14:46:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:46:14.526863 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-531f5feb-7af3-438e-ae0e-a40dae56a727 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:14.531867 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.wsgi [None req-531f5feb-7af3-438e-ae0e-a40dae56a727 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-531f5feb-7af3-438e-ae0e-a40dae56a727 admin admin] Request method failure captured: Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Accept: application/json Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Accept-Encoding: gzip, deflate Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Connection: keep-alive Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Content-Length: 0 Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Host: 10.222.0.60 Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Openstack-Api-Version: compute 2.92 Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Openstack-System-Scope: None Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: User-Agent: python-novaclient Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Auth-Token: gAAAAABjKIC13P1XR8KqNOIbJmcs1Bkaw9qGaIcWUO0AvGVXJuZVXRQOErj84nI41iK0AUAnBxmFtGlr0YJO7UhoUb5BWGos7KspHFmJOMjiZyUmE2NkCHjBYVKk57TC0i8wKeFeQs7nKOQTaWiIG6bZwJK5WRCZM64pBokpz_unhwfcqwdoeWI Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Domain-Id: None Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Domain-Name: None Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Identity-Status: Confirmed Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Is-Admin-Project: True Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Domain-Id: default Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Domain-Name: Default Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Project-Name: admin Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Role: member,admin,reader Sep 19 14:46:14.533374 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Roles: member,admin,reader Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b206fdda52da4f339c6c008d4c7973af", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b206fdda52da4f339c6c008d4c7973af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant: admin Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant-Id: b206fdda52da4f339c6c008d4c7973af Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-Tenant-Name: admin Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User: admin Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Domain-Id: default Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Domain-Name: Default Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Id: 7d770189a7bb4b81b8a42702f35fc84d Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: X-User-Name: admin Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: method: > Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: exception: Flavor 451 could not be found. Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: action_args: {'id': '451'} Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:46:14.535935 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:14.536900 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: ERROR nova.api.openstack.wsgi Sep 19 14:46:14.538173 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-531f5feb-7af3-438e-ae0e-a40dae56a727 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:46:14.539457 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-531f5feb-7af3-438e-ae0e-a40dae56a727 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011522 Sep 19 14:46:14.539457 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Sep 19 14:46:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 14:46:15.809674 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:15.810690 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 19 14:46:15.811114 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:16.344117 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-48f9e629-db2e-475e-b7c4-41245a68e663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:16.364113 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-48f9e629-db2e-475e-b7c4-41245a68e663 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.416171 Sep 19 14:46:16.364663 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Sep 19 14:46:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:46:17.578108 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:17.579143 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 19 14:46:17.579548 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:18.114354 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-4f0519a7-41aa-4901-b0ba-d490ef35a03f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:18.132750 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-4f0519a7-41aa-4901-b0ba-d490ef35a03f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.413420 Sep 19 14:46:18.133294 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Sep 19 14:46:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:46:19.369351 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:19.370361 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 19 14:46:19.370779 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:19.899549 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-a24e5d8b-8f28-4d15-948e-5eb27fca7340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:19.918308 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-a24e5d8b-8f28-4d15-948e-5eb27fca7340 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.408986 Sep 19 14:46:19.918779 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Sep 19 14:46:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:46:21.145250 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:21.146260 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 19 14:46:21.146655 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:21.674471 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-26de8b0d-ccf9-444f-8d0c-cdbc120cdcbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:46:21.693142 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-26de8b0d-ccf9-444f-8d0c-cdbc120cdcbe admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.411343 Sep 19 14:46:21.693689 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Sep 19 14:46:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:46:22.930934 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:22.931968 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 19 14:46:22.932362 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:46:23.467481 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-66df0107-0180-4f6a-ae6f-5e1bb7f6496b admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:46:23.489129 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-66df0107-0180-4f6a-ae6f-5e1bb7f6496b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.420417 Sep 19 14:46:23.489664 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Mon Sep 19 14:46:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:47:21.072892 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.073940 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-dc49f609-abd1-44b1-bc9b-e7de3c124c49 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 19 14:47:21.074347 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 931 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:47:21.085719 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:21.463189 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-2d61ab9d-9834-418f-9ee7-a3600d5c08b6 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.483673 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-2d61ab9d-9834-418f-9ee7-a3600d5c08b6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402463 Sep 19 14:47:21.484243 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1292 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:47:21.506131 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_api:SELECT=14 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:47:21.509417 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-e9e5ae3f-e0bf-4cd6-8e3b-88aaf4736307 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.516906 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-e9e5ae3f-e0bf-4cd6-8e3b-88aaf4736307 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012608 Sep 19 14:47:21.517440 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1283 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:21.529040 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-e8eebb98-9efc-4385-a0a6-17306470fd5d admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.536855 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-e8eebb98-9efc-4385-a0a6-17306470fd5d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011387 Sep 19 14:47:21.537367 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1286 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:21.549209 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.556673 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011688 Sep 19 14:47:21.557192 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1286 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:47:21.570597 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-b2e5a720-04fe-48e3-b80f-41000529e725 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:47:21.579372 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-b2e5a720-04fe-48e3-b80f-41000529e725 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013964 Sep 19 14:47:21.580162 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1283 bytes} [Mon Sep 19 14:47:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:50:21.165261 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:21.166298 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 19 14:50:21.166691 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:21.309754 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_api:SELECT=6 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:21.468597 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:21.473295 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:21.473769 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:21.474196 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:21.474906 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:21.475350 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:21.475766 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:21.506845 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-5c18cbc8-2e26-4950-b0a6-2101b06ee177 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198336 Sep 19 14:50:21.507407 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Sep 19 14:50:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:50:22.608958 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:22.609960 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 19 14:50:22.610360 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:22.816204 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:22.819598 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:22.820107 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:22.820538 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:22.821266 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:22.821713 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:22.822134 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:22.842271 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-94917cba-2fe3-4483-86fa-b6ec76a9cd99 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.086820 Sep 19 14:50:22.842838 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Sep 19 14:50:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:50:34.342897 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:34.343941 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 19 14:50:34.344343 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:50:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:34.487135 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_cell0:SELECT=4 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.487860 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_cell1:SELECT=4 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.488519 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG dbcounter [-] [111874] Writing DB stats nova_api:SELECT=8 {{(pid=111874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:50:34.537310 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:34.540811 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.541284 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.541714 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.542429 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:34.542874 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:34.543291 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:34.568702 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-6f218354-13ac-4b2d-826f-59d1df059d54 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085916 Sep 19 14:50:34.569261 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Sep 19 14:50:34 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:50:35.651639 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG nova.api.openstack.wsgi [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] Calling method '>' {{(pid=111873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:35.652680 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: INFO nova.api.openstack.requestlog [None req-1f5a2570-84c1-4b8d-ac00-b38d3220db94 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 19 14:50:35.653086 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: [pid: 111873|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Sep 19 14:50:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:50:35.842516 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG nova.api.openstack.wsgi [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Calling method '>' {{(pid=111874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:50:35.845874 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.846362 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.846783 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.847481 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:50:35.847945 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:50:35.848355 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: DEBUG oslo_concurrency.lockutils [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:50:35.869433 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: INFO nova.api.openstack.requestlog [None req-9671ee08-ae9d-4168-91a6-6ea1a2137c76 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078649 Sep 19 14:50:35.869916 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: [pid: 111874|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Sep 19 14:50:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:51:32.943141 dv-cinder-756709-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 14:51:32.943759 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: Mon Sep 19 14:51:32 2022 - graceful shutdown triggered... Sep 19 14:51:32.944231 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: Gracefully killing worker 1 (pid: 111873)... Sep 19 14:51:32.944597 dv-cinder-756709-7-iscsi devstack@n-api.service[111874]: Gracefully killing worker 2 (pid: 111874)... Sep 19 14:51:33.071338 dv-cinder-756709-7-iscsi devstack@n-api.service[111873]: DEBUG dbcounter [-] [111873] Writing DB stats nova_api:SELECT=4 {{(pid=111873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:51:33.944595 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: worker 1 buried after 1 seconds Sep 19 14:51:33.945138 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: worker 2 buried after 1 seconds Sep 19 14:51:33.945138 dv-cinder-756709-7-iscsi devstack@n-api.service[111872]: goodbye to uWSGI. Sep 19 14:51:33.946283 dv-cinder-756709-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 14:51:33.946844 dv-cinder-756709-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 14:51:33.949717 dv-cinder-756709-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 14:51:33.960027 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 14:51:33 2022] *** Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: nodename: dv-cinder-756709-7-iscsi Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: machine: x86_64 Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: clock source: unix Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: pcre jit disabled Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: detected number of CPU cores: 4 Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: current working directory: / Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: detected binary path: /usr/bin/uwsgi-core Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: your processes number limit is 47680 Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: your memory page size is 4096 bytes Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: detected max file descriptor number: 2048 Sep 19 14:51:33.962077 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: lock engine: pthread robust mutexes Sep 19 14:51:33.963025 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: thunder lock: enabled Sep 19 14:51:33.963025 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 14:51:33.963025 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 14:51:34.004740 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: Python main interpreter initialized at 0x55ea6f5959c0 Sep 19 14:51:34.004740 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: python threads support enabled Sep 19 14:51:34.004740 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: your server socket listen backlog is limited to 100 connections Sep 19 14:51:34.004740 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: your mercy for graceful operations on workers is 90 seconds Sep 19 14:51:34.005132 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 14:51:34.005213 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: *** Operational MODE: preforking *** Sep 19 14:51:34.005469 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: *** uWSGI is running in multiple interpreter mode *** Sep 19 14:51:34.005469 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: spawned uWSGI master process (pid: 126848) Sep 19 14:51:34.005673 dv-cinder-756709-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 14:51:34.007379 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: spawned uWSGI worker 1 (pid: 126869, cores: 1) Sep 19 14:51:34.007379 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: spawned uWSGI worker 2 (pid: 126870, cores: 1) Sep 19 14:51:34.007379 dv-cinder-756709-7-iscsi devstack@n-api.service[126848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 14:51:34.687176 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:51:34.687804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 14:51:35.860855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:51:35.860855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: from cryptography.utils import int_from_bytes Sep 19 14:51:35.861607 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:51:35.861607 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: from cryptography.utils import int_from_bytes Sep 19 14:51:35.862009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:51:35.862009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: from cryptography.utils import int_from_bytes Sep 19 14:51:35.862156 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 14:51:35.862156 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: from cryptography.utils import int_from_bytes Sep 19 14:51:38.264076 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:51:38.265005 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:51:38.265716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:51:38.266304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:51:38.266791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:51:38.267400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.268016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.268589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.269132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.269699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.270237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.270792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.271344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.271921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.272394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.272938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.273663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-7-iscsi {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.274219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.274747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.275292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.275866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.276955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.277504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.278038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.278906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.279470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.280022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.280549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.281146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.281675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.282206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.282750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.283277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.283866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.284413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-7-iscsi {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.295858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.296589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.296589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.296589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.296589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.296589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.296589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.311856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.312974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.313333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.315853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.316525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.316525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.316859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.319851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.320494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.320494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.320494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.320939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.321096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.323856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.331851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.337517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.343901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.345920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.346200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.351844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.353031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.354122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.354122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.354122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.354669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 14:51:38.355155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.356487 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.356487 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.356487 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.356487 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.357103 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.357103 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.357389 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-756709-7-iscsi {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.363848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365082 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365082 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365082 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365082 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365082 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365082 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-756709-7-iscsi {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.365918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.367007 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368113 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368113 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368552 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368845 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.368993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.369135 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.369276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.369433 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.369576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.369725 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.370400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.370552 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.370710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.370854 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.370854 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.371121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.371271 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.371421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.371574 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.371726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.375965 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.376147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.376320 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.376489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.376659 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.376659 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.376944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.377090 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.377242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.377400 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.377557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.377708 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.377853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.377994 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.378155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.378307 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.378450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.378600 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.378750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.378901 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.379056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.379207 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.379354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.379503 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.379643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.379783 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.379987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.380140 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.380432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.381498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.382606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.383554 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.383554 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.383554 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.384075 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.384075 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.386333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388088 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388088 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388088 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388088 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388088 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388793 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388793 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.388793 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.389293 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.389492 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.389698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.389979 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.389979 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.390332 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.390541 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.390898 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.391150 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.391466 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.391840 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.392098 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.392255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.392409 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.392589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.392753 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.392940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.393095 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.393317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.393483 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.393667 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.393912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.394109 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.394363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.394551 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.394743 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.395075 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.395226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.395370 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.395565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.395777 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.396062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.396273 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.396273 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.396682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.396914 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.397100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.397309 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.397609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.397839 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.398074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.398335 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 14:51:38.398515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.398782 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.398951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.399163 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.399385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.399636 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.399905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.400197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.402377 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.402377 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.402377 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.402377 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.402377 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.403045 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.403045 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.403332 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.403473 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.403678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.403860 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.404042 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.404459 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.404679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.404840 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405001 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405341 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405691 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.405998 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.406150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.406319 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.406475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.406652 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.406869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.407102 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.407360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.407575 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.407793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.408119 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.408360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.408574 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.408783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.408992 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.409201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.409432 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.409724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.409967 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.410174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.410605 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.410764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.410915 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411233 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.411654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.412861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.412861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.412861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.412861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.413957 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.413957 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.413957 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.414393 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.414393 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.414716 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.414929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.415161 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.415445 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.415602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.415805 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.416097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.416284 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.417479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.417635 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.417779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.417922 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.418149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.418405 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.418405 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.418405 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.418405 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.419283 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.419283 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.419283 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.420223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.420223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.420223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.420647 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.420799 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.427858 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.427858 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.427858 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.427858 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.427858 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428406 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428565 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428728 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428899 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.428973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429045 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429370 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429528 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429689 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429852 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.429926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430024 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430329 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430329 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430548 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.430711 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431126 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431801 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431801 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431801 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431801 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.431801 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.432188 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.433215 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.433215 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.433215 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.434369 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.434369 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.434369 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.434369 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.434952 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.435106 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.435495 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.435669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.435816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436015 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436331 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436658 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.436953 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.437615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.437800 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.437800 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.438164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.438315 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.438315 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.438629 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.438795 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.439242 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.439438 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.439674 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.440023 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.440357 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.440521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.440686 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.440834 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.440979 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.441132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.441288 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.441442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.441613 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.441785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.442511 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.442673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.442822 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.442978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.443134 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.443363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.443535 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.443717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.443928 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.443928 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.444257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.444257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.444567 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.444715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.444869 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.444869 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.445163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.445308 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.445461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.445637 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.446606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.446776 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.446935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.447094 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.447241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.447387 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.447532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.447691 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.447869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.448066 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.448219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.448378 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.448532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.448695 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.448850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449003 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449316 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449624 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.449923 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.450079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.450225 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.450379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.450525 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.450709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.451016 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.451228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.452323 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.452496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.452645 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.452791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.452937 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.453082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.453237 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.453441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.453611 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.453769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.454005 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.454258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.459990 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.459990 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.460388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461618 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461618 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461618 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.461930 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462117 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462935 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462935 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.462935 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.469964 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470208 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470208 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470208 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470554 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470721 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470900 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.470900 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471159 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471159 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471415 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471594 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471736 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.471954 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472135 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472293 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472465 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472651 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472651 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.472916 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473092 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473268 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473444 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473444 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473686 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473866 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.473958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474050 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474304 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474502 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474502 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474502 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474815 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.474995 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475173 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475263 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475349 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475523 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475700 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.475898 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484569 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484764 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.484943 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485122 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485304 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485474 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485651 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485737 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485829 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.485997 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486508 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486685 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486872 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.486965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487050 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487237 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487237 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487562 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487748 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.487934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488090 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488522 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.488971 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489278 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489576 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.489941 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.490098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.490098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.494412 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.494633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.494633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.495030 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.495194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.495349 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.495512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.495512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.495817 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.496007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.496159 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.496309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.496541 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.496707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.496863 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497191 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.497955 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.498105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.498253 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.498411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.498570 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.498720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.498875 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499184 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499492 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499492 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.499961 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.500122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.500272 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.500423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.500572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.500798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.500969 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501301 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501616 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501937 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.501937 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502374 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502374 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502374 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502957 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502957 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.502957 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.503401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.503559 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.503559 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.503876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.504032 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.504192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.504631 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.504792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.504951 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505101 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505250 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505250 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505250 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.505982 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.506140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.506140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.506441 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.506868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.506868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.507180 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.510887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.510887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.511247 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.511503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.511676 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.511676 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.511676 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.511676 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.512294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.512455 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.512606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.512756 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.512756 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513359 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513664 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.513984 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.514199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.514357 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.514799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.514959 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.515123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.515274 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.515423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.515592 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.515749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.515960 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516331 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516796 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.516948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.517247 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.517404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.517573 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.517573 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.517573 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.517573 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518360 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518817 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.518974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.519258 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.519258 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.519258 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.519697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.519867 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520172 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520489 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520802 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.520965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.521158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.521158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.521158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.521158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.521158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.521158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522379 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522687 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.522898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.523185 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.523344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.523344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.523344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.523344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.523954 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.524105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.524271 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.524271 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.524271 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.524271 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.525142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.525292 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.525452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.525612 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.525770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.525770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.526078 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.526754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.526754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527050 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527491 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527807 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.527994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.528442 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.528604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.528764 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.528914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.528914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.529195 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.529344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.529574 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.529727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.529877 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530638 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530638 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.530930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531097 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531689 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.531872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.532182 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.532346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.532495 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.532643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.532792 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.532940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533098 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533399 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533704 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.533867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.534150 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.534316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.534316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.534607 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.534766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.535179 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.535340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.535489 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.535645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.535645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.535965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.536126 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.536276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.536435 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.536584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.536894 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.537067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.537228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.537385 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.537542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.537852 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.538055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.538212 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.538362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.538519 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.538677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.538845 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539162 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539462 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539782 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.539973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.540134 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.540293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.540480 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.540638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.540813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.541147 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.541319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.541470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.541628 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.541920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.542586 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.542739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.542888 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.543036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.543193 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.543343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.543506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.543658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.543950 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.544111 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.544423 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.544579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.544742 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.544893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.545059 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.545461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.545627 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.545777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.545933 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.546097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.546257 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.546408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.546566 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.546717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.547476 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.547635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.547794 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.547985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548146 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548468 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548791 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548791 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.548791 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.549227 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.549227 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.549724 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.550096 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.550444 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.550842 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.551114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.551410 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.551568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.551740 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.551933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.552104 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.552365 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.552679 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.552992 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.553311 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.553649 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.553967 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.554300 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.554521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.554688 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.554882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.555050 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.555220 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.555726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.556196 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.556350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.556499 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.556499 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.556799 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.557075 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.557435 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.557761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.558085 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.558409 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.558864 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.559055 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.559352 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.559669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.560009 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.560168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.560338 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.560543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.560699 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.561047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.561206 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.561357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.561808 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.562016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.562173 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.562375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.562532 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.562715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.562882 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.563514 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.563694 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.563998 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.564175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.564485 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.564587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.564816 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.564918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.565140 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.565235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.565478 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.565819 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.565918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.566004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.566123 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.566219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.566462 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.566704 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.566799 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.567067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.567194 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.567400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.567500 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.567727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.567848 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.568099 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.568224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.568424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.568558 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.568766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.568900 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.569079 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.569203 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.569401 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.569535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.569724 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.569850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.570045 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.570262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.570390 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.570595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.570736 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.570939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.571214 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.571363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.571495 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.571625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.571756 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.572097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.572233 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.572424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.572558 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.572758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.572893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.573117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.573262 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.573459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.573593 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.573787 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.573927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.574110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.574254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.574434 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.574575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.574752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.574893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.575093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.575295 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.575436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.575619 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.575929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.576083 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.576351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.576496 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.576636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.576768 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.576951 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.577092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.577276 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.577418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.577611 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.577745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.577954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.578277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.578599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.578748 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.578927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.579062 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.579246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.579379 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.579566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.579700 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.579895 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.580026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.580235 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.580380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.580557 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.580734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.580873 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.581004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.581256 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.581409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.581540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.581669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.581985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.582151 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.582334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.582514 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.582648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.582975 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.583116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.583300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.583440 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.583638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.583772 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584136 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584316 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584789 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.584962 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.585103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.585278 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.585421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.585595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.585735 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.586037 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.586178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.586324 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.586525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.586679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.586810 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.587034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.587370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.587762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.588066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.588489 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.589340 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.589657 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.589980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.590294 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.590630 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.590945 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.591126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.591295 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.591527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.591693 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.591871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.592151 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.592460 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.592904 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.593352 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.593588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.593744 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.593894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.594051 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.594212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.594362 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.594524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.594705 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.594872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.595032 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.595191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.595341 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.595503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.595653 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.595802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.596233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.596391 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.596658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.596824 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.596976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.597126 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.597275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.597424 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.597588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.597737 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.597886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598036 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598659 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.598982 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.599139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.599292 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.599451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.599600 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.599749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.599927 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.600081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.600337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.600494 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.600662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.600867 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.601029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.601187 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.601351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.601527 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.601751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.601908 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.602064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.602214 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.602372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.602530 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.602714 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.603182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.603338 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.603488 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.603646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.603838 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.604136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.604928 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.605088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.605256 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.605424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.605574 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.605730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.605887 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.606048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.606364 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.606533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.606772 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.606772 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.607072 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.607223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.607223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.607523 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.607672 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.607852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608010 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608352 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608652 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.608951 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.609114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.609265 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.609414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.609565 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.609724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.609873 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.610044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.610196 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.610346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.610496 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.610651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.610819 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.611012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.611174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.611326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.611476 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.611632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.611941 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.612110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.612280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.612438 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.612588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.612744 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.612914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.613066 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.613233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.613484 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.613639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.613802 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.613961 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.614121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.614270 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.614445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.614613 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.614936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.615118 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.615319 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.615516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.615709 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.615923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.616118 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.616280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.616588 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.616783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617014 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617337 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617645 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.617962 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.618125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.618276 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.618433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.618739 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.618941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.619140 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.619140 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.619515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.619698 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.619906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.620068 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.620232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.620384 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.620806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.620970 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.621169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.621318 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.621495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.621645 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.621645 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622182 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622387 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622560 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.622814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.623091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.623186 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.623504 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.623855 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.624292 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.624429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.624517 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.624596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.624799 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.624975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.625146 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.625318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.625421 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.625624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.625728 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.625937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.626038 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.626310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.626408 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.626645 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.626835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.627049 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.627233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.627331 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.627580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.627690 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.628020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.628126 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.628378 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.628552 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.628714 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.628909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.629168 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.629279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.629503 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.629616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.629827 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.629937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.630145 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.630246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.630491 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.630595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.630811 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.630914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.631133 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.631250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.631457 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.631565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.631777 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.631902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.632241 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.632352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.632560 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.632666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.632884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.632992 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.633213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.633330 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.633517 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.633614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.633860 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.633962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.634185 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.634300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.634586 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.634697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.634878 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.634981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.635170 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.635264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.635475 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.635601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.635917 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636229 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636523 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636809 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.636987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.637097 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.637410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.637518 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.637724 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.637823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.638224 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.638330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.638407 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.638481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.638749 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.638851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.639050 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.639145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.639319 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.639413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.639682 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.639964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.640100 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.640318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.640420 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.640624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.640725 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.640956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.641070 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.641326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.641426 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.641652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642163 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642361 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642511 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642821 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.642991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.643190 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:51:38.643381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.643381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.643734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.644090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.644648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.644968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.645289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.645631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.645957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.646287 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.646569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.647020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.647477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.647781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.648130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.648978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.648978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.649311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.649473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.649657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.649974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.650296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.650613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.650933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.651801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.652144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.652579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.652904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.653251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.653575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.653905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.654444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.654752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.655062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.655372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.655679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.656046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.656343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.656681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.657105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.657527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.657968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.658286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.658602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.658927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.659246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.659572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.659922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.660238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.660557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.660878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.661211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.661555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.661949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.662279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.662695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.663000 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.663311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.663649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.664006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.664422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.664735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.665016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.665319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.665624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.665926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.666230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.666529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.666899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.667416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.667975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.668200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.668667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.668963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.669415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.669660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.669922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.670229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.670605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.670940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.671283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.671624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.672060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.672368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.672859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.673116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.673437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.673757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.674085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.674549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.674881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.675198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.675683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.675943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.676312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.676497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.676816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.677149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.677467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.677826 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.678157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.678465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.678795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.679116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.679451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.679755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.680096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.680430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.680752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.681321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.681635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.681973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.682289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.682666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.682972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.683286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.683606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.683947 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.684276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.684634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.684950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.685277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.685607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.685958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.686273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.686619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.687414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.687414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.687576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.687996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 14:51:38.688131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 14:51:38.706663 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO dbcounter [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Registered counter for database nova_api Sep 19 14:51:38.727684 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.734895 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writer thread running {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:38.750362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO dbcounter [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Registered counter for database nova_api Sep 19 14:51:38.771058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_db.sqlalchemy.engines [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.778437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writer thread running {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:38.792064 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.context [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fa6516d-d8a6-4e2a-89af-a6c10f9bd626(cell1) {{(pid=126869) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:51:38.796244 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.796729 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.798345 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.799092 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.799546 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.801595 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.803611 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO dbcounter [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Registered counter for database nova_cell0 Sep 19 14:51:38.808203 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO dbcounter [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Registered counter for database nova_cell1 Sep 19 14:51:38.815544 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.817385 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.824288 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writer thread running {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:38.825610 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writer thread running {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:38.835880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.context [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9fa6516d-d8a6-4e2a-89af-a6c10f9bd626(cell1) {{(pid=126870) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 14:51:38.840550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.840963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.842558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.843280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:51:38.843723 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:51:38.845744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:51:38.847740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO dbcounter [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Registered counter for database nova_cell0 Sep 19 14:51:38.851848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO dbcounter [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Registered counter for database nova_cell1 Sep 19 14:51:38.859572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_db.sqlalchemy.engines [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.860922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_db.sqlalchemy.engines [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.866879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writer thread running {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:38.869411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writer thread running {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:38.977314 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO dbcounter [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Registered counter for database nova_cell0 Sep 19 14:51:38.984110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_db.sqlalchemy.engines [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:38.988750 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writer thread running {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:39.017095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO dbcounter [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Registered counter for database nova_cell0 Sep 19 14:51:39.024071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_db.sqlalchemy.engines [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 14:51:39.029725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writer thread running {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 14:51:39.311400 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: WARNING keystonemiddleware.auth_token [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:51:39.323938 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: WARNING keystonemiddleware.auth_token [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:51:39.351602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: WARNING keystonemiddleware.auth_token [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:51:39.358987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: WARNING keystonemiddleware.auth_token [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:51:39.666148 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: WARNING keystonemiddleware.auth_token [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:51:39.672314 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: WARNING keystonemiddleware.auth_token [None req-3cf9aa27-979e-4dc8-833d-df7377539f38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:51:39.677895 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ea6f5959c0 pid: 126869 (default app) Sep 19 14:51:39.702479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: WARNING keystonemiddleware.auth_token [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 14:51:39.708538 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: WARNING keystonemiddleware.auth_token [None req-1e0fb97e-3a96-495d-8a05-5fccb41168ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 14:51:39.714518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ea6f5959c0 pid: 126870 (default app) Sep 19 14:52:17.174824 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_api:SELECT=3 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:17.184322 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=3 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:17.186216 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell0:SELECT=3 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:17.187416 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell0:SELECT=3 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:18.572865 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-b8ebd14d-064f-46e8-8da6-879a3e13f3de tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Action: 'create', calling method: .version_select at 0x7f9f3a88d4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1020397888", "metadata": {"Type": "work"}}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:19.758076 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-b8ebd14d-064f-46e8-8da6-879a3e13f3de tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.599909 Sep 19 14:52:19.759755 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Sep 19 14:52:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2603 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 14:52:19.777608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:19.778721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:19.779597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:19.781342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:20.202882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-88ee2c2b-ad0c-41b5-b836-675d94200161 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Calling method '.version_select at 0x7f9f3a8d6160>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:20.741455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-88ee2c2b-ad0c-41b5-b836-675d94200161 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4" status: 200 len: 354 microversion: 2.1 time: 0.969774 Sep 19 14:52:20.742373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:52:19 2022] GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4 => generated 354 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:20.755866 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-15142dc5-d1f0-4d8b-a84a-9a2cfd822201 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Calling method '.version_select at 0x7f9f3a75f3a0>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:20.864112 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-15142dc5-d1f0-4d8b-a84a-9a2cfd822201 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4" status: 200 len: 354 microversion: 2.1 time: 0.112269 Sep 19 14:52:20.864817 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:52:20 2022] GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:20.887266 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fbf734ab-2c32-439a-b87a-0afb68c1d27d tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Calling method '.version_select at 0x7f9f3a79e310>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:21.083373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fbf734ab-2c32-439a-b87a-0afb68c1d27d tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4" status: 202 len: 0 microversion: 2.1 time: 0.202680 Sep 19 14:52:21.084336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:52:20 2022] DELETE /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:52:21.094977 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-77761576-af08-4b01-b8ee-4007cf0e8481 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Calling method '.version_select at 0x7f9f3a75fa60>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:21.173507 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-77761576-af08-4b01-b8ee-4007cf0e8481 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4" status: 200 len: 353 microversion: 2.1 time: 0.084129 Sep 19 14:52:21.175272 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:52:21 2022] GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:22.191061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e0bbbe5c-64c9-48ae-9b3b-4c80709056b5 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Calling method '.version_select at 0x7f9f3a79e9d0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:22.250283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-e0bbbe5c-64c9-48ae-9b3b-4c80709056b5 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] HTTP exception thrown: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e0bbbe5c-64c9-48ae-9b3b-4c80709056b5 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Request method failure captured: Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4 HTTP/1.1 Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIg3R5ZZ0JqyUmRu1409AkYMgX0CqPSmhBi1OPmE0lPojqfhE-D5OrCbKJdRJB3p5W1q0PwC1ztgM-3JEolQcCeSMaK_IhPGMHNsh43xSF8IkYTXwIQm15bl2IDh3R3O4XkCbwkmoCDTq4W1WTTtJ4R7S7a6-rENgwSbLjtM1-s8ck Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 505a2b7bf4e64b689bd8081324cb729e Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesGetTestJSON-865858019 Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:52:22.256463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_505a2b7bf4e64b689bd8081324cb729e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/505a2b7bf4e64b689bd8081324cb729e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/505a2b7bf4e64b689bd8081324cb729e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/505a2b7bf4e64b689bd8081324cb729e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesGetTestJSON-865858019 Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 505a2b7bf4e64b689bd8081324cb729e Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesGetTestJSON-865858019 Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesGetTestJSON-865858019-project Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 97342c4d7ffc40a29286e2457dc06615 Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesGetTestJSON-865858019-project Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'ea4f752b-92f7-43cf-ae35-0115684d7ea4'} Sep 19 14:52:22.257911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. (HTTP 404) (Request-ID: req-781b4f62-db44-4bdc-93e7-321074ed7f4a) Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:22.258823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:52:22.260637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 14:52:22.261764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. Sep 19 14:52:22.262806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:52:22.266175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e0bbbe5c-64c9-48ae-9b3b-4c80709056b5 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] Returning 404 to user: Volume ea4f752b-92f7-43cf-ae35-0115684d7ea4 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:52:22.268254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e0bbbe5c-64c9-48ae-9b3b-4c80709056b5 tempest-VolumesGetTestJSON-865858019 tempest-VolumesGetTestJSON-865858019-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4" status: 404 len: 109 microversion: 2.1 time: 0.083339 Sep 19 14:52:22.276326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:52:22 2022] GET /compute/v2.1/os-volumes/ea4f752b-92f7-43cf-ae35-0115684d7ea4 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:52:30.466737 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-0a1c8f51-df01-4a39-b650-ab72294a6061 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'create', calling method: .version_select at 0x7f9f3a6fe040>, body: {"keypair": {"name": "tempest-keypair-1873823172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+FpOXoErfU9kbNPK9e7jZW5pR62f/wwt/1UarYFlMMif1WDIg4rG9xWbc7JAW0ukxZUgMz4x+B13MnBsAlFcUYCI4kLoFbIRnAUpQbQ0NAb3/RW/jN5XQVddS2GLbQQw=="}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:30.564523 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-0a1c8f51-df01-4a39-b650-ab72294a6061 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for project db03071b1326441bb9571432be926bf5. Resources: {'key_pairs'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:30.575221 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-0a1c8f51-df01-4a39-b650-ab72294a6061 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for user b2c40600d2fd4eea8e4ba999050abd73 and project db03071b1326441bb9571432be926bf5. Resources: {'key_pairs'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:30.699620 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-0a1c8f51-df01-4a39-b650-ab72294a6061 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.538415 Sep 19 14:52:30.701266 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 4/7] 10.222.0.60 () {62 vars in 1200 bytes} [Mon Sep 19 14:52:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 541 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 14:52:31.410206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1529519840", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:31.597600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] validate_networks() for [('55ef7907-f8b2-4450-8200-3b3560538feb', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:35.241195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:35.241864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:35.242224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:35.242630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:35.243125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:35.291280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.291760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.292286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.293007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:35.293461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:35.293882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:35.362483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:35.378023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for user 1cccf354894c4311b7710d8a65682eeb and project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:35.408413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:35.412950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:35.563262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9b5cff86-0ce6-4207-b78b-20fba3ecb1e9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.873130 Sep 19 14:52:35.572532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 4/8] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:35.581013 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-0eeb08bc-68d8-4721-8ce8-ad6d90faa1cb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:35.582155 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-0eeb08bc-68d8-4721-8ce8-ad6d90faa1cb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:35.960976 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-0eeb08bc-68d8-4721-8ce8-ad6d90faa1cb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:35.986506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-0eeb08bc-68d8-4721-8ce8-ad6d90faa1cb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1222 microversion: 2.1 time: 0.412051 Sep 19 14:52:35.990516 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:35 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1222 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:36.594619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-405323856", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:36.725260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] validate_networks() for [('55ef7907-f8b2-4450-8200-3b3560538feb', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:36.943420 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-117145120", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e38065f1-625e-45cf-a407-4391527fb143"}], "security_groups": [{"name": "tempest-securitygroup--1973903883"}], "key_name": "tempest-keypair-1873823172", "user_data": "}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:37.415474 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.network.neutron [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] validate_networks() for [('e38065f1-625e-45cf-a407-4391527fb143', None, None, None, None, None)] {{(pid=126869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:38.442589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:38.443165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:38.443812 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:38.444854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:38.445643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:38.484010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.487280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.489295 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.495353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:38.497276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:38.499817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:38.625135 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:38.669315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for user 1cccf354894c4311b7710d8a65682eeb and project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:38.799782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:38.839595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:39.031800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f84b5cbd-35ec-4ffc-8bd4-299a3a9acc0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.442105 Sep 19 14:52:39.032642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 5/10] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:39.679078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2e9ac302-2202-4ae2-8831-323954cc3ee5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: .version_select at 0x7f9f39de4790>, body: {"keypair": {"name": "tempest-keypair-275884561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D4jAwzbuS6HFwjfGwuabhUz/eOQQxjSgdqDltT11ZoQhSECPlrXLIcZjAHPhsgWM0yPrEaQ88mHmEgJ/108/mG0A1VX/G7gPc8chvDeBoUqAnf1lxN/lcJKlBPM+kMg=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:39.769390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-2e9ac302-2202-4ae2-8831-323954cc3ee5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:39.785089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-2e9ac302-2202-4ae2-8831-323954cc3ee5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:39.862648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2e9ac302-2202-4ae2-8831-323954cc3ee5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.828885 Sep 19 14:52:39.864764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 6/11] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:52:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:39.880366 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9d91e946-0098-4758-834c-f8ffc3e865c1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:39.882587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9d91e946-0098-4758-834c-f8ffc3e865c1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:40.033823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9d91e946-0098-4758-834c-f8ffc3e865c1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:40.056465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9d91e946-0098-4758-834c-f8ffc3e865c1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1221 microversion: 2.1 time: 0.188800 Sep 19 14:52:40.057573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:39 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:40.893777 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Flavor limits 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:40.895073 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Image limits 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:40.895762 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Flavor pref 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:40.896455 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Image pref 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:40.897143 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:40.914178 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.915636 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.916337 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:40.917304 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:40.917872 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:40.918454 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:40.947894 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for project db03071b1326441bb9571432be926bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:40.952730 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for user b2c40600d2fd4eea8e4ba999050abd73 and project db03071b1326441bb9571432be926bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:40.968095 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Going to run 1 instances... {{(pid=126869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:40.971863 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:41.082001 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-4a691fe1-f2f3-4d62-9a8d-b2a89dd1a2b1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.143649 Sep 19 14:52:41.092798 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 6/13] 10.222.0.60 () {62 vars in 1188 bytes} [Mon Sep 19 14:52:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 4155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 14:52:41.098513 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:41.099467 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:41.107416 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:41.108280 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:41.108965 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.111537 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:41.112298 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:41.113379 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:41.200525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1507498658", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "networks": [{"uuid": "58958a7b-0285-44a3-9672-28f6d88d6fca"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:41.322335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] validate_networks() for [('58958a7b-0285-44a3-9672-28f6d88d6fca', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:41.453693 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.479953 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-d048e2f9-38dc-4624-9675-8118a97a0502 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1225 microversion: 2.1 time: 0.384708 Sep 19 14:52:41.495857 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 7/14] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:41 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1225 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:41.513071 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-09a5dbba-49c2-4a16-8536-b4344cef4c3b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:41.513782 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-09a5dbba-49c2-4a16-8536-b4344cef4c3b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:41.704834 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-09a5dbba-49c2-4a16-8536-b4344cef4c3b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.721662 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-09a5dbba-49c2-4a16-8536-b4344cef4c3b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.727711 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-09a5dbba-49c2-4a16-8536-b4344cef4c3b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:41.730171 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-09a5dbba-49c2-4a16-8536-b4344cef4c3b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1281 microversion: 2.20 time: 0.241215 Sep 19 14:52:41.730904 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 8/15] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:41 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:42.513815 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:42.515112 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:42.529296 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.532036 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.532648 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.533511 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.542295 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.542991 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.615049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:42.615525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:42.615994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:42.616421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:42.616815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:42.637454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.644230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.644689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.648738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.649304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.649751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.688327 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:42.698014 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-d6227c3b-d0d9-4b2c-b634-4f770f2cc90c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1225 microversion: 2.1 time: 0.188608 Sep 19 14:52:42.720548 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:42 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1225 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:42.737802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Getting quotas for project a0009b7d4f2545ffab964938384d40b6. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:42.749539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Getting quotas for user 49b775647ffb4500911c8ec8cf2ec804 and project a0009b7d4f2545ffab964938384d40b6. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:42.761043 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:42.761673 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:42.787440 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.789740 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.790388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.796966 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:42.797669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:42.798560 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:42.815570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:42.818035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:43.038015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2046a2e3-26db-479f-a72b-d944f8faa29a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.370686 Sep 19 14:52:43.038644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 8/17] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:43.072889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-567749d8-c6aa-43a9-8285-72db78e561ed tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:43.074556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-567749d8-c6aa-43a9-8285-72db78e561ed tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:43.526209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-567749d8-c6aa-43a9-8285-72db78e561ed tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:43.549039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-567749d8-c6aa-43a9-8285-72db78e561ed tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1215 microversion: 2.1 time: 0.476301 Sep 19 14:52:43.549864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 9/18] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:43 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1215 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:43.597498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:43.612459 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:43.629437 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:43.630804 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-b19cfe03-a559-408c-96df-7b17a0a4477a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1285 microversion: 2.20 time: 0.875596 Sep 19 14:52:43.654440 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 10/19] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:42 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1285 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:52:43.728459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:43.729310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:43.745758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:43.746373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:43.749211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:43.749981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:43.750464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:43.750901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.307699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:44.332106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ca8b9eb0-fe0e-488c-9790-687521a094ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1273 microversion: 2.1 time: 0.608025 Sep 19 14:52:44.340792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 10/20] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:43 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1273 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:44.579336 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:44.580149 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:44.605497 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.606119 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.606496 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.607256 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.607716 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.619425 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.666332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:44.667186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:44.714662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.714968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.715409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.716207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:44.716731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:44.717161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:44.909715 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:44.924820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:44.933459 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-36a0cf7a-2df7-4ae1-8ffa-846d3120209a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1219 microversion: 2.1 time: 0.358875 Sep 19 14:52:44.935029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:44.936202 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 11/21] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:44 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1219 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:44.938649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:44.942230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e8d59a3e-83fe-4d10-bc36-ad66476e33f7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1333 microversion: 2.20 time: 0.281219 Sep 19 14:52:44.943043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 11/22] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:44 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:52:45.157706 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-431157661", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be7d8aa6-9b4b-4d6b-91e8-89101b447c76"}], "security_groups": [{"name": "tempest-securitygroup--2030382314"}], "key_name": "tempest-keypair-275884561", "user_data": "}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:45.361158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:45.362151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:45.375315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:45.383793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:45.384503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:45.385910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:45.396199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:45.397036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:45.558528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:45.568778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-76682861-c7f1-425b-a14b-5385401a91c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1279 microversion: 2.1 time: 0.211372 Sep 19 14:52:45.579529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:45 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:45.608191 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.network.neutron [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] validate_networks() for [('be7d8aa6-9b4b-4d6b-91e8-89101b447c76', None, None, None, None, None)] {{(pid=126869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:52:45.959174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:45.959794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:46.001862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.002376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.002822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.003535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.004094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.004524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.152771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.164358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4f20f31c-224e-4850-8b76-1b257f66e586 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.208919 Sep 19 14:52:46.165835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 13/24] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:45 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:46.173925 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:46.174851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:46.185854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.187468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.188851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.190409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.191887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.193862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.341957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.359708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.364057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.365251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e96cfb65-6eeb-4107-96d9-ebc4f3c5c1b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1341 microversion: 2.20 time: 0.198160 Sep 19 14:52:46.386774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 14/25] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:46 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:46.606393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:46.607303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:46.628992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.630884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.632926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.635974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:46.636671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:46.637277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:46.968425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:46.980577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1b7dd0de-3113-417b-9f41-a7d58d75a460 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1279 microversion: 2.1 time: 0.380427 Sep 19 14:52:46.983760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 15/26] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:46 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1279 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:47.190679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:47.191522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:47.206774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.207514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.208030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.208793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.212255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.212910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.346191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:47.356021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-42879e56-8f3d-4e71-9805-7c69b6cebec1 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.169002 Sep 19 14:52:47.379131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 16/27] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:47 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:47.394154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:47.395271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:47.405041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.405843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.406476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.407439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.408116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.408943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.496683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:47.506993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:47.508889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:47.510249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-eca1bbf9-9344-4786-9bb3-34ac0cf73f8e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1341 microversion: 2.20 time: 0.120130 Sep 19 14:52:47.511041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 17/28] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:47 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1341 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:47.592778 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor limits 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:52:47.593256 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image limits 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:52:47.593904 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor pref 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:52:47.594457 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image pref 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:52:47.603669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:52:47.617669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.618438 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.619124 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.620123 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:47.620783 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:47.621414 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:47.649381 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:52:47.657214 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:52:47.688241 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Going to run 1 instances... {{(pid=126869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:52:47.691548 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:52:47.822164 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-0d5403f3-17cf-4ad8-8c62-f0a97c2ff1fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.669056 Sep 19 14:52:47.823409 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 12/29] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:52:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:52:47.838951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-11a11c3a-7271-4862-a10e-821c9272b4cb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:47.839577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-11a11c3a-7271-4862-a10e-821c9272b4cb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:47.899330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-11a11c3a-7271-4862-a10e-821c9272b4cb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:47.907774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-11a11c3a-7271-4862-a10e-821c9272b4cb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1240 microversion: 2.1 time: 0.073074 Sep 19 14:52:47.908935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 18/30] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:47 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:48.012862 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:48.013527 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:48.023221 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.024144 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.024663 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.025476 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.026159 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.026826 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.296327 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:48.319256 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-caca0543-83e2-4a8e-b286-913043e8faa2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.313037 Sep 19 14:52:48.320142 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 13/31] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:48 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:48.393467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:48.396551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:48.408706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.414094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.415585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.416733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.417355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.417940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.536447 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:48.537151 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:48.550879 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.551377 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.551839 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.557188 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.558499 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.560088 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.561982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:48.573924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-07975f52-0fe8-439e-845f-287a40bd866a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.190965 Sep 19 14:52:48.583885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 19/32] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:48 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:48.651631 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:48.660810 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:48.662442 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:48.663754 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e3413bb0-b5ea-4adc-96ba-33c216d0a2d0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1341 microversion: 2.20 time: 0.131189 Sep 19 14:52:48.664741 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 14/33] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:48 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1341 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:48.935342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:48.942694 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:48.965687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.966184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.966617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:48.967327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:48.967778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:48.968221 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.068284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.089575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b801a506-4d86-49e6-9b54-a6d2788e97ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1244 microversion: 2.1 time: 0.161392 Sep 19 14:52:49.092124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 20/34] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:48 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:49.345816 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:49.346753 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.359362 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.365572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.366356 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.368406 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.370637 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.371530 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.603064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:49.607199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.630782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.631298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.631753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.632640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.632981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.639296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.660129 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.670127 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f661254b-0673-44a2-a178-7e233b317df5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.328370 Sep 19 14:52:49.684956 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 15/35] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:49 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:49.694499 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:49.695397 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:49.702887 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.703413 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.703866 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.704574 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:49.705027 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:49.705451 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:49.804820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.823918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4659e6a5-b974-454a-84b5-d7bd84224c7b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.227862 Sep 19 14:52:49.825304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 21/36] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:49 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:49.882670 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.895134 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.897022 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:49.899201 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-2e67b41a-bdea-4b7a-b4c0-5942ceb3bb9d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1341 microversion: 2.20 time: 0.208310 Sep 19 14:52:49.913980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 16/37] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:49 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:52:50.125272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:50.126148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:50.159955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.160445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.168320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.171020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.176799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.178230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.585028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:50.598441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7f2852be-f7a7-436b-8279-9af3e68f8b8a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1244 microversion: 2.1 time: 0.486147 Sep 19 14:52:50.599048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 22/38] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:50 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1244 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:50.703384 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:50.704044 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:50.717323 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.718090 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.718708 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.719578 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.720338 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.720946 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.848462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:50.849766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:50.856201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.856672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.857134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.857816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.858256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.858672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.923079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:50.933328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4f586fe1-c657-4be7-91e6-cca97e576e17 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.088865 Sep 19 14:52:50.933921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 23/39] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:50 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:50.938683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:50.939288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:50.942199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:50.946640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.947125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.947597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:50.948318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:50.948767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:50.949187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.016533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.024838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.026325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.027453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-04851663-d2c6-4218-bc4b-3f6dd539f4dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.092609 Sep 19 14:52:51.033391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 24/40] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:50 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:51.116500 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.124486 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f3685316-b119-47c1-89e8-e51ac6b57920 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.427935 Sep 19 14:52:51.125077 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 17/41] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:50 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:51.623391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:51.623391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:51.631957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.632732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.633375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.634901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.636118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.636751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.741839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:51.750672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9b30d85b-1a45-4385-bf7b-ca94de798c81 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1236 microversion: 2.1 time: 0.133889 Sep 19 14:52:51.751437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 25/42] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:51 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1236 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:51.957287 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:51.958114 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:51.965188 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.965673 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.966422 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:51.967240 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:51.967800 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:51.968310 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.052827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:52.053473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:52.060775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.061264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.061858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.062750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.063218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.063642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.084427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:52.133922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.142697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.144248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.145357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0cb0665f-6730-4f56-99ca-41d1c4856600 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.096676 Sep 19 14:52:52.145917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 26/43] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:52 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:52.151104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:52.151709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:52.158363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.158847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.159431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.160067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.160535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.160957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.231866 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.241437 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-45c55f22-9f34-4c3e-ba31-2f89e6443730 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.289214 Sep 19 14:52:52.243150 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 18/44] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:51 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:52.310688 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8687a47-c664-4e00-961a-7e735ca2254c", "tag": "c67e14ea-7899-4204-8e10-f7a30d3a861b"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:52.325282 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.325780 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.326228 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.341736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.353638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a5addbfc-7bd6-400e-a6ee-a6f33d12107e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.206448 Sep 19 14:52:52.354544 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 27/45] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:52 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:52.367910 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Creating event network-changed:c67e14ea-7899-4204-8e10-f7a30d3a861b for instance a8687a47-c664-4e00-961a-7e735ca2254c on hv-cinder-75670 Sep 19 14:52:52.368626 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:52:52.369232 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-0d48a1ea-4261-4fb3-b94c-483604300cf0 req-eb9cec52-8db2-4fad-8e41-781b14721f65 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:52:52.370508 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.371094 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.371771 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.372592 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.373105 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.373586 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.384998 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.compute.rpcapi [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 14:52:52.385824 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] Releasing lock "compute-rpcapi-router" {{(pid=126869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:52:52.402478 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-fa74f57c-108e-48cb-aada-aaf3dc4ce394 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157441 Sep 19 14:52:52.403083 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 19/46] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:52.775341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:52.775989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:52.777978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=6 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:52.784696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.785176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.785658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.786295 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:52.786738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:52.787156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:52.848330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:52.857007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7053dc2a-c3ec-40ed-8d60-e7616232607b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1236 microversion: 2.1 time: 0.086253 Sep 19 14:52:52.857560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 28/47] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:52 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:53.172402 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:53.173109 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:53.179179 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.179652 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.180115 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.180896 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.181600 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.182017 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.244311 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:53.252431 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:53.253901 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:53.255001 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-18df496e-6199-4282-9bed-d4767f19d60a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.086957 Sep 19 14:52:53.255553 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 20/48] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:53 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:53.264876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:53.265572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:53.271515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.272099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.272630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.273316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.274443 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.274864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.334900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:53.343521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a77dae33-4964-4523-8421-0bfc1fa36417 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.082283 Sep 19 14:52:53.344058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 29/49] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:53 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:53.381049 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:53.381664 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:53.388277 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.388766 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.389199 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.389959 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.390418 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.390993 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.570389 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:53.579042 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-276a06c1-ad42-4263-af9e-aa163e7a62ec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.202113 Sep 19 14:52:53.579615 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 21/50] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:53 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:53.889080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:53.890861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:53.908799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.909303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.909746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:53.910671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:53.911423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:53.916185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.027865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.039023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c915d755-1f97-4dba-a331-3d97f9ff856c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1236 microversion: 2.1 time: 0.162142 Sep 19 14:52:54.040925 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 30/51] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:53 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1236 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:54.281626 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:54.282805 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:54.290997 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.291649 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.292396 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.293684 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.294132 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.294721 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.368136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:54.369087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:54.377323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.378321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.379005 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.380232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.380990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.381661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.386252 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.399695 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.404033 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.405935 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-ddae3e32-95d3-437a-b1e7-96d16d641b43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.129158 Sep 19 14:52:54.440694 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 22/52] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:54 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:54.442518 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-8fe097f5-4f1d-4a40-80e4-1d64823835f1 req-1141d3b1-13e9-4ffd-82c4-8cf8ea90e2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c3dc74-07a1-4032-88cd-fae46c1e9f70", "tag": "b9e6540e-5c0b-4fdb-8f91-a01a88c01a3d"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:52:54.471568 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-8fe097f5-4f1d-4a40-80e4-1d64823835f1 req-1141d3b1-13e9-4ffd-82c4-8cf8ea90e2b4 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.473556 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-8fe097f5-4f1d-4a40-80e4-1d64823835f1 req-1141d3b1-13e9-4ffd-82c4-8cf8ea90e2b4 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.474758 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-8fe097f5-4f1d-4a40-80e4-1d64823835f1 req-1141d3b1-13e9-4ffd-82c4-8cf8ea90e2b4 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.514143 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-8fe097f5-4f1d-4a40-80e4-1d64823835f1 req-1141d3b1-13e9-4ffd-82c4-8cf8ea90e2b4 service nova] Creating event network-changed:b9e6540e-5c0b-4fdb-8f91-a01a88c01a3d for instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 on hv-cinder-75670 Sep 19 14:52:54.529703 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-8fe097f5-4f1d-4a40-80e4-1d64823835f1 req-1141d3b1-13e9-4ffd-82c4-8cf8ea90e2b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095405 Sep 19 14:52:54.532231 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 23/53] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:52:54.551042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.568211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-416c8782-3a23-4f9c-a9fa-0615a71afd15 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.203355 Sep 19 14:52:54.569237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 31/54] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:54 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:54.606506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:54.607508 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:54.616573 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.617130 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.618063 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.619224 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:54.619700 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:54.628391 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:54.823231 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:54.831431 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-fd7f18d9-98da-4e58-887c-807a66201e80 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.232526 Sep 19 14:52:54.833613 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 24/55] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:54 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:55.064488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.065212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:55.080125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.085245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.087128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.090714 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.091603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.092084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.200687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:55.215171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f7a31657-a6fe-4816-b7b4-d6f0aab33f73 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1236 microversion: 2.1 time: 0.154716 Sep 19 14:52:55.216513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 32/56] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:55 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1236 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:55.439489 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.440953 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:55.450035 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.451074 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.452145 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.453539 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.454307 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.455106 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.558193 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:55.567161 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=100 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:55.572803 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:55.575423 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:55.577258 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-9c3a35bf-4223-4be4-852c-6fc9a3befb83 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.142499 Sep 19 14:52:55.578417 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 25/57] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:55 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:55.597372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.597984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:55.645114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.652588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.657175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.661419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.664683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.667361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.863386 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:55.864545 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:55.891767 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.892351 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.892799 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.893521 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:55.893965 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:55.904270 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:55.919123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:55.931587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-367fe39d-34fa-4111-8362-eaf8cc77db3b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.340943 Sep 19 14:52:55.945704 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 33/58] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:55 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:56.239492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:56.240164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:56.262147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.264328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.275611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.278605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.281874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.283584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.453713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.468584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ff139e50-2622-4415-9789-a2473b1cbb71 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1236 microversion: 2.1 time: 0.233385 Sep 19 14:52:56.475990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 34/59] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:56 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1236 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:56.605725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:56.606399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:56.617689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.618367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.618929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.619778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.626644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.627312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.630797 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.647191 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-8ac02a9d-51cf-46c1-92d6-9277a698298e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.787744 Sep 19 14:52:56.651275 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 26/60] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:55 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:56.741028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.758928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.768976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:56.770387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f52f45df-b0d6-424a-bb00-98b33ad70cb1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.168612 Sep 19 14:52:56.771124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 35/61] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:56 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:56.971542 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:56.972525 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:56.987287 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:56.992106 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:56.995711 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:56.998387 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.000525 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.002404 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.166468 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:57.195144 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-ba77b105-3def-418f-9d7b-066a8622ce77 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.228054 Sep 19 14:52:57.200779 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 27/62] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:56 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:57.497646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:57.498226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:57.504872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.505629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.506902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.508979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.509629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.510244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.622370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:57.636508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-74738c58-87ab-42b0-b306-e12317af813b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1236 microversion: 2.1 time: 0.147402 Sep 19 14:52:57.640061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 36/63] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:57 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1236 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:57.676294 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:57.677804 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:57.686898 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell0:SELECT=20 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:57.699776 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.702266 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.704141 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.707540 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.708202 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.709078 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.803489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:57.806675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:57.821910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.822410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.830822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.831663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:57.832173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:57.832610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:57.918404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=28 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:58.069236 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.083061 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-8a6235da-167e-4ac1-ad61-098afff5a2fc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.411691 Sep 19 14:52:58.088715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.096767 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 28/64] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:57 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:58.106264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.116227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.125842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5cd52e1e-f44d-4694-bfd3-0024a3d11a79 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.326928 Sep 19 14:52:58.134868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 37/65] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:57 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:58.227808 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:58.228871 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:58.254656 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.255523 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.257752 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.260390 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.268602 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.271706 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.667340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:58.668891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:58.694433 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.696237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.700108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.702584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.705547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:58.706292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:58.708536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:58.709544 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-68c125d7-5eb5-4ded-8143-e8acf5097ee4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1267 microversion: 2.1 time: 0.488360 Sep 19 14:52:58.716637 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 29/66] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:58 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1267 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:58.952278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:58.968389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-67d2bb06-b15b-432b-b3ef-4ce723281c9a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1292 microversion: 2.1 time: 0.306760 Sep 19 14:52:58.970172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 38/67] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:58 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1292 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:52:59.111166 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.112690 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:59.136161 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:52:59.145689 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.150386 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.150930 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.151762 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.158256 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.159121 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.170115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.171110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:59.186099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.189477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.190433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.194043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.195139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.199420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.544792 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:59.560906 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-5d0e28bc-9d50-4426-a366-4683cf368a7e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.456172 Sep 19 14:52:59.576065 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 30/68] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:52:59.749299 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.750423 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:52:59.756594 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.757849 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.758508 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.759636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:59.761459 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:52:59.763740 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:52:59.765142 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:52:59.771857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:59.773377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:52:59.774488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8d0b9d30-8522-4545-96cf-2cd84fba1572 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1339 microversion: 2.20 time: 0.610320 Sep 19 14:52:59.782133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 39/69] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1339 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:52:59.996171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:52:59.997424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.006756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.007646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.009255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.011423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.012735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.013682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.046743 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:00.054389 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-1da2522b-cc83-4685-aafe-d9a4fe6ae0b2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1273 microversion: 2.1 time: 0.314797 Sep 19 14:53:00.055522 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 31/70] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:00.142173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:00.154475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3af26023-5947-4320-8ac6-2caaf79c7269 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1292 microversion: 2.1 time: 0.164819 Sep 19 14:53:00.155621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 40/71] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:52:59 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1292 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:00.593430 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.594071 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.603865 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.604395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.604891 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.613986 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.614503 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.614950 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.806369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:00.806996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:00.817946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.818456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.818901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:00.819626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:00.820113 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:00.820623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.259567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.273090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.277499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.285018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3da9c199-2ec0-4e44-a578-e46bff12c9a7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.484019 Sep 19 14:53:01.285619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 41/72] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:00 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:53:01.312321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.319235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:01.335167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.335663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.336182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.336906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.337354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.337858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.827387 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.840127 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-ee9f857b-744e-4bc6-8461-b5ce86f6cc09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 1.251395 Sep 19 14:53:01.845304 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 32/73] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:00 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:01.850609 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:01.851506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:01.862067 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.862558 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.862997 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.863703 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:01.864209 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:01.864821 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:01.918981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:01.927708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7ce5d29f-45d6-4410-aaf3-92ac119d255e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.629728 Sep 19 14:53:01.928553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 42/74] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:01 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.105743 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.119908 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-2e5a5a0c-e17c-473c-9988-33890a9d855c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1298 microversion: 2.1 time: 0.272624 Sep 19 14:53:02.122192 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 33/75] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:01 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1298 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:02.319547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.320663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.337197 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.340529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.344603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.347646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.349702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.350282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.364163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:02.788215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.801557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.805456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:02.810289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1443824f-aad0-46cf-ab3e-ed513f921379 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.497540 Sep 19 14:53:02.811585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 43/76] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:02.868286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.869666 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.872504 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell0:SELECT=6 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:02.878691 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.879358 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.879854 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.884515 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.884974 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.885405 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.950794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:02.952318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:02.960061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.960622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.969746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:02.970600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:02.971082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:02.971507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.449382 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:03.476387 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-2f6afcb8-c144-4fd4-bc1d-2c7ea340cd4d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.609644 Sep 19 14:53:03.480366 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 34/77] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:03.502500 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.503857 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.513046 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.513743 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.514936 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.516175 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.516796 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.517482 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.542992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:03.555145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0d5d429c-4776-4689-af5a-85e1ab94798a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.607759 Sep 19 14:53:03.559212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 44/78] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:02 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:03.737260 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:03.754328 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-92b0a053-24fc-4b49-9833-3816f86792c0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1298 microversion: 2.1 time: 0.271270 Sep 19 14:53:03.755295 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 35/79] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:03 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1298 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:03.841001 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:03.841661 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:03.851138 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.856096 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.856841 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.857895 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.858535 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.859184 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:03.966960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:03.992037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:03.993384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:03.994577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.031451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Creating event network-changed:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:53:04.033003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 14:53:04.033662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ac1c2d84-6b9f-45f3-8b9c-661bf0c7f4e7 req-d4b5516b-3644-4719-a60a-d58f4bede4d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 14:53:04.035459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.037382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.038096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.040685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.042298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.042934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.059439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.compute.rpcapi [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 14:53:04.060799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=126870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 14:53:04.092825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-69a7a24d-ef2a-46fb-92af-fd8c876036e8 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320329 Sep 19 14:53:04.093882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 45/80] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:04.193424 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.206428 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.209179 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.210530 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-87322275-7072-49bd-8581-dc700ff4b460 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.373926 Sep 19 14:53:04.211797 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 36/81] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:03 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:04.504103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.504889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.518059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.519498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.521212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.523317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.526924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.527672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.591621 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.592821 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.605690 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.608237 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.614650 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.616650 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.617396 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.618372 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.818929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.828425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-03c384a4-4fbc-4c1e-b8d5-4396971a60e2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.329335 Sep 19 14:53:04.830835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 46/82] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:04.842218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:04.843763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:04.859091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.861852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.862676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.865203 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:04.865686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:04.866122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:04.945773 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:04.954423 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f32d6410-12a5-4f9a-849c-350c2998a430 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.366893 Sep 19 14:53:04.955006 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 37/83] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:05.174104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:05.190178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-30f3d29a-6099-4550-a720-f65f955f5caa tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.357269 Sep 19 14:53:05.194063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 47/84] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:04 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:05.237492 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:05.238226 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:05.250617 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.252951 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.254217 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.256672 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.259027 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.259664 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.696215 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:05.708058 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:05.709942 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:05.711514 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f6404399-364f-426d-ada5-e48077a63ded tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.478307 Sep 19 14:53:05.725525 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 38/85] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:05 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:05.862729 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:05.863710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:05.879584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.881301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.882648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.884359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:05.889940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:05.891182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:05.988969 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:05.990855 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.003947 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.004457 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.004903 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.007748 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.009506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.010688 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.394252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:06.420186 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:06.426788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-42172266-a543-4f6e-ba70-3134552b4e0a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.569743 Sep 19 14:53:06.431637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 48/86] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:05 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.438684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-1470d5ee-e7e6-4fd1-a09c-26894dcfe8ab req-f2c59acb-f3a9-4a01-b911-39aeba569bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aef9202-211a-4866-bf76-72c706512a32", "tag": "9432a444-6a2d-4193-b1fc-67c4974a9173"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:06.440243 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-0be94c65-fb47-4023-b2c0-3b82dd0407c2 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.462367 Sep 19 14:53:06.451856 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 39/87] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:05 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.452469 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.458451 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.474529 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.475031 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.475465 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.480790 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.481352 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.483308 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.488283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1470d5ee-e7e6-4fd1-a09c-26894dcfe8ab req-f2c59acb-f3a9-4a01-b911-39aeba569bfa service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.488768 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1470d5ee-e7e6-4fd1-a09c-26894dcfe8ab req-f2c59acb-f3a9-4a01-b911-39aeba569bfa service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.489202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1470d5ee-e7e6-4fd1-a09c-26894dcfe8ab req-f2c59acb-f3a9-4a01-b911-39aeba569bfa service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.502746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-1470d5ee-e7e6-4fd1-a09c-26894dcfe8ab req-f2c59acb-f3a9-4a01-b911-39aeba569bfa service nova] Creating event network-changed:9432a444-6a2d-4193-b1fc-67c4974a9173 for instance 7aef9202-211a-4866-bf76-72c706512a32 on hv-cinder-75670 Sep 19 14:53:06.509318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-1470d5ee-e7e6-4fd1-a09c-26894dcfe8ab req-f2c59acb-f3a9-4a01-b911-39aeba569bfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075262 Sep 19 14:53:06.510229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 49/88] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:06.742568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:06.744341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:06.754671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.755410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.756129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.757224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.759297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.759992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.862388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:06.876963 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-50dd1a89-2e0f-4739-b2d5-6d806f94b429 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.434472 Sep 19 14:53:06.877981 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 40/89] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:06 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:06.900833 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-3af743db-6a73-4a3b-a39b-1e1231f47a35 req-62a36c84-0163-4067-95ba-e373a897ed13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1f4045-79b2-43d2-b1c4-e0a77d7d338b", "tag": "88d66ec9-13e4-4177-84dc-a8ef92c4eebb"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:06.918981 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-3af743db-6a73-4a3b-a39b-1e1231f47a35 req-62a36c84-0163-4067-95ba-e373a897ed13 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:06.918981 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-3af743db-6a73-4a3b-a39b-1e1231f47a35 req-62a36c84-0163-4067-95ba-e373a897ed13 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:06.918981 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-3af743db-6a73-4a3b-a39b-1e1231f47a35 req-62a36c84-0163-4067-95ba-e373a897ed13 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:06.949643 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-3af743db-6a73-4a3b-a39b-1e1231f47a35 req-62a36c84-0163-4067-95ba-e373a897ed13 service nova] Creating event network-changed:88d66ec9-13e4-4177-84dc-a8ef92c4eebb for instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b on hv-cinder-75670 Sep 19 14:53:06.965974 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-3af743db-6a73-4a3b-a39b-1e1231f47a35 req-62a36c84-0163-4067-95ba-e373a897ed13 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069973 Sep 19 14:53:06.967501 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 41/90] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:07.022210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:07.032987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:07.036626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:07.036906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8281bb7f-6391-47a5-87e5-524c1b7a1c4a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.301788 Sep 19 14:53:07.044312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 50/91] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:06 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:07.468334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:07.468948 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:07.469305 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:07.469379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:07.479739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.480478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.482073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.484015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.484932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.485789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.490552 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.496560 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.497017 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.498498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.499051 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.500606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.815483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:07.839137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-40d089ce-a792-4bb8-96e7-2ee689ad6cc8 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.377177 Sep 19 14:53:07.843105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 51/92] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:07 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:07.902588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:07.903450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:07.918980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.919559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.920091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.920879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:07.921394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:07.921889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:07.952705 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:07.966942 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-5972cba1-5660-4ce7-9849-cc20bae12590 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.520104 Sep 19 14:53:07.969478 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 42/93] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:07 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:08.072831 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:08.073661 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:08.087637 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.088173 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.088615 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.089376 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.089770 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.100919 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.118709 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=100 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:08.401228 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:08.410524 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:08.412443 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:08.413885 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-34caeb28-7541-45b2-8cf0-80e94e96fd03 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.345292 Sep 19 14:53:08.448583 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 43/94] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:08 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:53:08.802802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:08.815392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5c179cf9-399b-4796-89c6-b223f9fc5af3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.916791 Sep 19 14:53:08.824376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 52/95] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:07 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:08.866070 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:08.866893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:08.892983 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.893670 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.896855 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.900905 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:08.901419 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:08.901861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:08.994848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:08.995860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:09.008694 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.012216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.012918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.013815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.014415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.014991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.236997 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.246762 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e05dc0ab-59ab-4944-af68-9623910a989c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.385793 Sep 19 14:53:09.262107 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 44/96] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:08 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:09.333539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.343334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-07fef8e5-503c-41b8-a224-9ac10ecb408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.352130 Sep 19 14:53:09.356869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 53/97] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:08 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:09.442723 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:09.443251 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:09.449722 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.450412 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.450844 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.451736 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.452225 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.452657 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.597665 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.608192 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.609767 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:09.611189 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-82da9bf6-4e2e-4fe3-b9d2-7f3aad94af72 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.172529 Sep 19 14:53:09.611785 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 45/98] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:09 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:09.843227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:09.843864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:09.852462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.853127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.853708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:09.854609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:09.855251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:09.855978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.279394 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.280374 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.311875 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.312372 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.312806 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.313870 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.314629 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.315197 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.326398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:10.363100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-be26aa5e-4a57-43cd-aa12-3c5302b8af1d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.521311 Sep 19 14:53:10.372829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 54/99] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:09 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:10.399655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.401662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.422602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.423459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.426370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.427810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.430545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.431458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.787081 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:10.787081 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-114afdf9-28c4-4901-97bf-25c951cdc3dd tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.509567 Sep 19 14:53:10.787709 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 46/100] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:10 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:10.809896 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:10.811276 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:10.819149 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.820146 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.821299 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:10.822333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:10.822993 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:10.823590 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.086120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.096911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-537d0bd8-086e-4a6d-a45e-a1d330eda942 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.718848 Sep 19 14:53:11.098163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 55/101] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:10 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:11.100781 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.111754 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.113406 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.114694 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-ae6f0648-8609-4e9e-b0ea-9d7e85befcc9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.312999 Sep 19 14:53:11.115789 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 47/102] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:10 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:11.394772 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:11.401945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-a4bd14d2-77fb-4c03-b4fd-77ef399f0561 req-c1eaf4e8-aae4-4e6d-b8f5-65206e7bb139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8687a47-c664-4e00-961a-7e735ca2254c", "name": "network-vif-plugged", "status": "completed", "tag": "c67e14ea-7899-4204-8e10-f7a30d3a861b"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:11.404359 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:11.417630 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.418113 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.418579 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.419271 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.419725 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.420169 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.422331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a4bd14d2-77fb-4c03-b4fd-77ef399f0561 req-c1eaf4e8-aae4-4e6d-b8f5-65206e7bb139 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.422799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a4bd14d2-77fb-4c03-b4fd-77ef399f0561 req-c1eaf4e8-aae4-4e6d-b8f5-65206e7bb139 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.423224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a4bd14d2-77fb-4c03-b4fd-77ef399f0561 req-c1eaf4e8-aae4-4e6d-b8f5-65206e7bb139 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.448798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-a4bd14d2-77fb-4c03-b4fd-77ef399f0561 req-c1eaf4e8-aae4-4e6d-b8f5-65206e7bb139 service nova] Creating event network-vif-plugged:c67e14ea-7899-4204-8e10-f7a30d3a861b for instance a8687a47-c664-4e00-961a-7e735ca2254c on hv-cinder-75670 Sep 19 14:53:11.457626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-a4bd14d2-77fb-4c03-b4fd-77ef399f0561 req-c1eaf4e8-aae4-4e6d-b8f5-65206e7bb139 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357857 Sep 19 14:53:11.458669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 56/103] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:11.587903 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.602176 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-c4025b34-812f-4f40-8729-064394f1f2b5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.212926 Sep 19 14:53:11.602810 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 48/104] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:11 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:11.812366 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:11.813058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:11.819089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.819810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.820487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.821374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:11.821914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:11.822414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:11.967116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:11.979080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-354f7884-e9c4-4b4c-86ef-b4229be8bf42 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.170771 Sep 19 14:53:11.979679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 57/105] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:11 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:12.122863 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.123900 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.133657 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.134151 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.136515 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.137485 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.138133 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.138750 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.142129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.143257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.152126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.153224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.153860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.155389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.156191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.156820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.306629 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.316399 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-88e614a8-8866-49e0-aad4-08efbb4ad54d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.199115 Sep 19 14:53:12.317689 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 49/106] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:12.327247 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.338650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.340272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.341416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0ce6967c-3ea1-4ca7-9f9a-3c8088537059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.204078 Sep 19 14:53:12.341999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 58/107] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:53:12.626266 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:12.627058 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:12.633753 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.634233 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.634660 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.635347 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:12.635789 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:12.636262 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:12.771604 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:12.780110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-b7c940fa-6431-4e80-8a2a-ede7a6ba67d2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.157688 Sep 19 14:53:12.780732 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 50/108] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:13.003996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.004594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.011368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.011868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.012303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.013262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.013442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.013856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.207187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.216094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-59fafc11-dc5f-4858-a817-09a2aa14219b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.215986 Sep 19 14:53:13.222614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 59/109] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:12 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:13.339626 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.340118 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.347011 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.347865 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.348453 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.349315 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.349755 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.350341 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.371851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.372575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.385441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.385898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.386322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.387616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.388126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.388515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.793939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.828891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.830869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.832186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-70546db9-3247-4f33-b16a-a42007fdff4c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.468681 Sep 19 14:53:13.832793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 60/110] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:13 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:13.852389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-25df2a55-d1ac-4bb0-8834-ec328f8877d0 req-30a34cca-f884-4017-99bf-83b3d7914049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c3dc74-07a1-4032-88cd-fae46c1e9f70", "name": "network-vif-plugged", "status": "completed", "tag": "b9e6540e-5c0b-4fdb-8f91-a01a88c01a3d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:13.868998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-25df2a55-d1ac-4bb0-8834-ec328f8877d0 req-30a34cca-f884-4017-99bf-83b3d7914049 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.872774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-25df2a55-d1ac-4bb0-8834-ec328f8877d0 req-30a34cca-f884-4017-99bf-83b3d7914049 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.873554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-25df2a55-d1ac-4bb0-8834-ec328f8877d0 req-30a34cca-f884-4017-99bf-83b3d7914049 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.899498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:13.900051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-25df2a55-d1ac-4bb0-8834-ec328f8877d0 req-30a34cca-f884-4017-99bf-83b3d7914049 service nova] Creating event network-vif-plugged:b9e6540e-5c0b-4fdb-8f91-a01a88c01a3d for instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 on hv-cinder-75670 Sep 19 14:53:13.905128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-25df2a55-d1ac-4bb0-8834-ec328f8877d0 req-30a34cca-f884-4017-99bf-83b3d7914049 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070636 Sep 19 14:53:13.905664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 61/111] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:13.910229 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f5751a45-2063-44a9-892b-aeee9aa2ee74 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.574600 Sep 19 14:53:13.911529 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 51/112] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:13 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:13.914268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:13.915176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:13.922440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.923097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.923647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.924472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:13.925089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:13.925585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:13.931632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:14.057865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:14.221398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:14.230007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1fc89793-b8cb-426c-b808-7aa5019b50f8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.322417 Sep 19 14:53:14.242974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 62/113] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:13 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:14.249062 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:14.249679 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:14.259695 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.260212 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.260650 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.261458 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.261920 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.262351 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.416186 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:14.427335 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-44708a4e-c466-4ded-b66c-a662f125fe5b tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.182740 Sep 19 14:53:14.427936 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 52/114] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:14 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:14.862819 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:14.863420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:14.869913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.870403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.870815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.871493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.871965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.872582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.936453 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:14.937416 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:14.946810 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.947800 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.949457 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:14.950706 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:14.951397 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:14.952066 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.032338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.044766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.046492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.047753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fd4a0bd2-fe1a-4024-803b-a64fb0064669 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.189104 Sep 19 14:53:15.048560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 63/115] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:14 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:15.111505 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.119489 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-359da4d3-b5f5-4920-9794-ae6aa7be1d35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.188125 Sep 19 14:53:15.120085 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 53/116] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:14 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:15.256634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:15.258434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:15.265514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.272396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.273511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.274917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.276130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.276582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.452175 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:15.452329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.452807 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:15.459059 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.461428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f20e22dd-6db7-4175-a457-aea46c6200cf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.209946 Sep 19 14:53:15.462620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 64/117] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:15 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:15.477371 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.478265 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.479094 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.479662 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.480195 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.621979 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:15.641795 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-7aaf001c-a743-48b9-b6ad-88e893e42fec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.191307 Sep 19 14:53:15.644652 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 54/118] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:15 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:15.948532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-4441e947-896e-4054-b2da-2c0a17a47a2f req-3b6949d0-3e89-4c75-9ecf-28e6b6b1726f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "name": "network-vif-plugged", "status": "completed", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:15.962463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4441e947-896e-4054-b2da-2c0a17a47a2f req-3b6949d0-3e89-4c75-9ecf-28e6b6b1726f service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:15.962943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4441e947-896e-4054-b2da-2c0a17a47a2f req-3b6949d0-3e89-4c75-9ecf-28e6b6b1726f service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:15.963373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4441e947-896e-4054-b2da-2c0a17a47a2f req-3b6949d0-3e89-4c75-9ecf-28e6b6b1726f service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:15.978131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-4441e947-896e-4054-b2da-2c0a17a47a2f req-3b6949d0-3e89-4c75-9ecf-28e6b6b1726f service nova] Creating event network-vif-plugged:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:53:15.983930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-4441e947-896e-4054-b2da-2c0a17a47a2f req-3b6949d0-3e89-4c75-9ecf-28e6b6b1726f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041418 Sep 19 14:53:15.985262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 65/119] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:16.077675 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.078633 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.086459 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.087044 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.087552 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.088355 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.088889 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.089418 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.142901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.143602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.150936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.151446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.151907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.153227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.153674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.154090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.237772 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.246472 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.247946 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.249066 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e8545b39-b05b-4e5a-beb1-9f85d948ba3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.179400 Sep 19 14:53:16.249636 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 55/120] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:16.313590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.322076 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b11c9679-88af-414e-9c9c-8a5f17b4cdbf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.183308 Sep 19 14:53:16.322643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 66/121] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:16.484375 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.484976 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.490933 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.491558 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.492045 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.492893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.493346 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.493773 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.626287 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.634775 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-3cfd2aa0-f95b-4e9b-a36c-a4142dba2dc3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.154198 Sep 19 14:53:16.635341 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 56/122] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:16.665193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:16.665790 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:16.671683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.672187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.672608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.673276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:16.673717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:16.674129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:16.805347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:16.813367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-25b528ab-d25f-47f9-9d3d-3e7e25dff54e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.152085 Sep 19 14:53:16.813930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 67/123] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:16 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:17.274408 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.274964 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.280943 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.281417 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.281852 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.282532 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.282983 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.283401 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.345235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.345831 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.352453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.352938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.353373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.354063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.354510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.354930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.411335 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.420081 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.421539 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.422822 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-118edceb-1a9b-422e-93b3-67e110f803dd tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.152456 Sep 19 14:53:17.423384 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 57/124] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:17.484925 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.492490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-151312ff-cdbf-4386-a00e-9a065bb944e0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.151112 Sep 19 14:53:17.493061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 68/125] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:17.657443 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.658059 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.664585 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.665068 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.665502 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.666195 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.666647 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.667070 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.802339 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.815803 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-2131eee7-2593-4b2e-a0cd-866076bc59c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.162097 Sep 19 14:53:17.816415 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 58/126] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:17.836721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:17.837327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:17.843894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.844376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.844814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.845503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:17.845954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:17.846376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:17.976988 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:17.984598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a3a376e5-0d54-4357-ae6f-d26779f08b5c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.152366 Sep 19 14:53:17.985158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 69/127] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:17 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:18.003141 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-3ec73537-70a7-4bf8-a111-62930ff1ad42 req-805a353b-4776-4cf6-bc82-1866d3ac8038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aef9202-211a-4866-bf76-72c706512a32", "name": "network-vif-plugged", "status": "completed", "tag": "9432a444-6a2d-4193-b1fc-67c4974a9173"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:18.013213 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-3ec73537-70a7-4bf8-a111-62930ff1ad42 req-805a353b-4776-4cf6-bc82-1866d3ac8038 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.013683 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-3ec73537-70a7-4bf8-a111-62930ff1ad42 req-805a353b-4776-4cf6-bc82-1866d3ac8038 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.014109 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-3ec73537-70a7-4bf8-a111-62930ff1ad42 req-805a353b-4776-4cf6-bc82-1866d3ac8038 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.025858 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-3ec73537-70a7-4bf8-a111-62930ff1ad42 req-805a353b-4776-4cf6-bc82-1866d3ac8038 service nova] Creating event network-vif-plugged:9432a444-6a2d-4193-b1fc-67c4974a9173 for instance 7aef9202-211a-4866-bf76-72c706512a32 on hv-cinder-75670 Sep 19 14:53:18.030972 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-3ec73537-70a7-4bf8-a111-62930ff1ad42 req-805a353b-4776-4cf6-bc82-1866d3ac8038 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Sep 19 14:53:18.031572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 59/128] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:18.450616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.451215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.457238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.457718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.458148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.458857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.459305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.459721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.515321 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.516051 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.522130 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.522608 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.523041 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.523731 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.524215 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.524635 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.545123 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=100 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:18.597313 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:18.606322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:18.607786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:18.608924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-18bcd159-32f2-4130-817e-4bb7a158170d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.162258 Sep 19 14:53:18.609484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 70/129] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:18 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:18.659587 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:18.667806 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-30468c73-3ca5-408e-b5cc-229489e54c8e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1321 microversion: 2.1 time: 0.156726 Sep 19 14:53:18.668428 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 60/130] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:18 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:18.848860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:18.849540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:18.856548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.857065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.857681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:18.858534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:18.859169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:18.859762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.021780 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:19.023521 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:19.034512 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.035054 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.035645 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.037146 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.037734 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.038422 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.047599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.057880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a93114d6-e00d-45a7-82b7-bd9e06c7dfa1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.211504 Sep 19 14:53:19.059982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 71/131] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:18 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:19.220155 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.234618 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-669c8d54-3703-4114-bc07-89da2c00a9ab tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.231026 Sep 19 14:53:19.235940 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 61/132] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:19 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:19.633847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:19.634441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:19.641178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.641971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.642356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.643241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.643853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.645393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.691524 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:19.692191 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:19.701944 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.702427 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.702854 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.703545 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.704012 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.704619 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.857036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.865900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.868157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.869304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3096ff16-0b3b-4809-8c43-6b2abaed7ad9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.239444 Sep 19 14:53:19.869866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 72/133] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:19 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:19.906057 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:19.916304 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-97429310-2f2e-4406-a631-b4a68751b7c0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1516 microversion: 2.1 time: 0.228162 Sep 19 14:53:19.916771 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 62/134] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:19 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:19.940208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:19.942644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:19.949019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.949507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.949941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:19.950829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:19.951433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:19.952054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.016935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'flavor' on Instance uuid a8687a47-c664-4e00-961a-7e735ca2254c {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:20.068672 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-6fbc0e1e-a86b-4fdf-b8ef-aadb26d70f7a req-6ea2120d-58f4-48b8-b779-edfdf3cab455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1f4045-79b2-43d2-b1c4-e0a77d7d338b", "name": "network-vif-plugged", "status": "completed", "tag": "88d66ec9-13e4-4177-84dc-a8ef92c4eebb"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:20.093002 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-6fbc0e1e-a86b-4fdf-b8ef-aadb26d70f7a req-6ea2120d-58f4-48b8-b779-edfdf3cab455 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.093523 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-6fbc0e1e-a86b-4fdf-b8ef-aadb26d70f7a req-6ea2120d-58f4-48b8-b779-edfdf3cab455 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.094410 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-6fbc0e1e-a86b-4fdf-b8ef-aadb26d70f7a req-6ea2120d-58f4-48b8-b779-edfdf3cab455 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.107474 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-6fbc0e1e-a86b-4fdf-b8ef-aadb26d70f7a req-6ea2120d-58f4-48b8-b779-edfdf3cab455 service nova] Creating event network-vif-plugged:88d66ec9-13e4-4177-84dc-a8ef92c4eebb for instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b on hv-cinder-75670 Sep 19 14:53:20.114420 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-6fbc0e1e-a86b-4fdf-b8ef-aadb26d70f7a req-6ea2120d-58f4-48b8-b779-edfdf3cab455 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057017 Sep 19 14:53:20.124295 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 63/135] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:20.131223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:20.132567 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:20.139506 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.140142 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.140817 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.142037 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.142712 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.143562 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.212131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7ae2ef01-eeed-4855-8ff8-d25ebe9ebe7b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c/action" status: 200 len: 32 microversion: 2.1 time: 0.275896 Sep 19 14:53:20.212868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 73/136] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:53:19 2022] POST /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:53:20.223414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:20.224399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:20.228167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:20.233200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.233976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.234351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.235051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.235681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.236121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.302907 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:20.312045 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-a6123751-0e96-478e-b389-155d93df548b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.185700 Sep 19 14:53:20.312701 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 64/137] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:20 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:20.319141 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:20.320068 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:20.327125 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.327662 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.328242 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.329103 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.329641 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.330173 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.417740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:20.428157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-55b8a55c-ddf8-405a-a324-c465b9e326bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.209140 Sep 19 14:53:20.429478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 74/138] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:20 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:20.495861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:20.503756 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-76c387d7-462b-44e1-a3bf-be7fa1c5827c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.189358 Sep 19 14:53:20.504750 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 65/139] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:20 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:20.897493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:20.898981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:20.906620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.907523 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.912993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:20.912993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:20.912993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:20.912993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.100807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.113884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.116144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.117561 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dde93818-5f04-471c-8176-e6d11ef244e7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1407 microversion: 2.20 time: 0.224558 Sep 19 14:53:21.118387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 75/140] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:20 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:21.335028 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:21.336565 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:21.343910 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.344584 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.345078 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.345773 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.346213 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.346624 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.453794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:21.454475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:21.461471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.462274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.462937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.463884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.464534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.465177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.509044 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.518320 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-5c50fdf1-496f-4127-a020-d0af16c255f0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.187767 Sep 19 14:53:21.518914 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 66/141] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:21 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:21.532151 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:21.536275 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:21.543250 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.544401 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.545249 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.547287 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:21.548829 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:21.549557 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:21.658578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.668290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5e023fd8-540b-4faa-81e5-7b67af4f01a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.218420 Sep 19 14:53:21.670083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 76/142] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:21 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:21.715590 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:21.726980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-641441df-72bb-4c9e-abab-4cdaa0a105da tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1315 microversion: 2.1 time: 0.197953 Sep 19 14:53:21.730356 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 67/143] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:21 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:22.145885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:22.146491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:22.155471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.156171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.156610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.157307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.157756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.158178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.196271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:22.497370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.511407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.513969 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.515385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b9adf551-e2dd-4176-a778-0bec6db0c3f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1600 microversion: 2.20 time: 0.374651 Sep 19 14:53:22.516186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 77/144] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:53:22 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1600 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:53:22.541029 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:22.541634 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:22.554854 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.557103 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.560022 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.561043 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.561771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:22.562394 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.563058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:22.563653 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.580916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.581416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.581863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.582657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.583198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.584057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.776071 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:22.792944 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-8df7a7d5-c089-4eef-99fd-0cfa5174c743 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.253486 Sep 19 14:53:22.794053 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 68/145] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:22 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:22.798894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d42870c4-3648-4791-a6d7-f190b3fabf47 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.248182 Sep 19 14:53:22.799908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 78/146] 10.222.0.60 () {60 vars in 1316 bytes} [Mon Sep 19 14:53:22 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-interface => generated 285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:53:22.818398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:22.819320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:22.823717 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:22.824968 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:22.828687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.829294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.830130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.830948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.831502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.832224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.841555 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.842825 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.843448 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:22.845210 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:22.845841 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:22.847854 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:23.031300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:23.039874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f4bdf824-0fac-4900-9529-41a58de05961 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1502 microversion: 2.1 time: 0.237911 Sep 19 14:53:23.040808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 79/147] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:22 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:23.189667 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:23.198922 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-739a3bc2-7618-4767-8adf-65e3acace36c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.389589 Sep 19 14:53:23.200049 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 69/148] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:22 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:23.822104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:23.823455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:23.831514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.832551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.833421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:23.834633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:23.836756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:23.838210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.040135 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:24.052997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6154575c-1319-497e-871c-d64bcfe0c5a3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1366 microversion: 2.1 time: 0.234110 Sep 19 14:53:24.053631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 80/149] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:23 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:24.222956 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:24.223856 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:24.233290 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.234031 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.234789 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.235669 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.236294 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.236974 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.503386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c8b3755-d4e4-4b19-91f2-8f534f060698"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:24.507361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:24.515138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.515721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.516184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.517006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.517508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.518164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.768218 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:24.781239 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-603da526-cc03-4ae6-b89c-5aae6316ab6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.558408 Sep 19 14:53:24.781883 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 70/150] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:24 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:24.889189 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-e79b83f3-e816-4bc4-ad4f-2e54e1c8448b req-4f5f555d-d166-406e-9b8c-98f18f99e385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:24.922804 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-e79b83f3-e816-4bc4-ad4f-2e54e1c8448b req-4f5f555d-d166-406e-9b8c-98f18f99e385 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:24.923621 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-e79b83f3-e816-4bc4-ad4f-2e54e1c8448b req-4f5f555d-d166-406e-9b8c-98f18f99e385 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:24.929481 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-e79b83f3-e816-4bc4-ad4f-2e54e1c8448b req-4f5f555d-d166-406e-9b8c-98f18f99e385 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:24.937469 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-977fdba8-a38b-4092-b745-571d4159d8d4 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "POST /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438087 Sep 19 14:53:24.938274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 81/151] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:53:24 2022] POST /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:53:24.999949 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-e79b83f3-e816-4bc4-ad4f-2e54e1c8448b req-4f5f555d-d166-406e-9b8c-98f18f99e385 service nova] Creating event network-changed:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:53:25.011160 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-e79b83f3-e816-4bc4-ad4f-2e54e1c8448b req-4f5f555d-d166-406e-9b8c-98f18f99e385 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125280 Sep 19 14:53:25.012521 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 71/152] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:25.080101 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:25.081057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:25.098876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.100328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.101911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.103549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.104696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.105992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.694335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:25.705031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ba6d4c00-67ca-421f-92eb-a6a4c1aa057f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1556 microversion: 2.1 time: 0.630368 Sep 19 14:53:25.705613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 82/153] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:25 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1556 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:25.739541 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:25.740294 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:25.750073 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.750660 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.751167 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.752258 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.752964 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.763125 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.806131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:25.806997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:25.817725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.818237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.818687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.819564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:25.820057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:25.820510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:25.938121 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-edcbe59d-fd40-451d-9d7d-f05daec5d047 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205023 Sep 19 14:53:25.939904 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 72/154] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:53:25 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:26.459093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:26.471635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e1c2f1fb-1c7b-416b-ab9e-29572741bda2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.670236 Sep 19 14:53:26.486970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 83/155] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:25 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:27.510806 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:27.514035 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:27.527490 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.530162 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.530839 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:27.533326 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.546723 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.547690 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:27.845761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:27.854870 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-9e11e7f6-3699-4c9c-b2d5-569000fc43ca tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.355248 Sep 19 14:53:27.857577 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 73/156] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:27 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:27.970986 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-caefa4e4-d9ad-467a-bbea-1b8ec1352081 req-c0e23306-d039-48ad-b3e6-b45028e92819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1f4045-79b2-43d2-b1c4-e0a77d7d338b", "tag": "88d66ec9-13e4-4177-84dc-a8ef92c4eebb"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:27.989903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-caefa4e4-d9ad-467a-bbea-1b8ec1352081 req-c0e23306-d039-48ad-b3e6-b45028e92819 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:27.994645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-caefa4e4-d9ad-467a-bbea-1b8ec1352081 req-c0e23306-d039-48ad-b3e6-b45028e92819 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:27.995103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-caefa4e4-d9ad-467a-bbea-1b8ec1352081 req-c0e23306-d039-48ad-b3e6-b45028e92819 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:28.046456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-caefa4e4-d9ad-467a-bbea-1b8ec1352081 req-c0e23306-d039-48ad-b3e6-b45028e92819 service nova] Creating event network-changed:88d66ec9-13e4-4177-84dc-a8ef92c4eebb for instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b on hv-cinder-75670 Sep 19 14:53:28.052451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-caefa4e4-d9ad-467a-bbea-1b8ec1352081 req-c0e23306-d039-48ad-b3e6-b45028e92819 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084939 Sep 19 14:53:28.054133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 84/157] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:28.889764 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:28.891927 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:28.906527 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:28.915362 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:28.916231 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:28.917930 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:28.920047 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:28.920661 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:29.338411 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:29.349223 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-c0bbd4f0-fb80-40b9-9b3e-4fc6aa407228 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.465462 Sep 19 14:53:29.350182 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 74/158] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:28 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:30.377885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:30.378592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:30.385842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:30.386358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:30.387219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:30.388108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:30.388703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:30.389269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:30.614412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:30.622183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-79e4d527-4267-40f0-b840-c17012265dec tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.248795 Sep 19 14:53:30.622753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 85/159] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:30 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:31.647152 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:31.648527 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:31.650824 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_api:SELECT=89 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:31.665067 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:31.665407 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:31.665841 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:31.668336 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:31.671031 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:31.673172 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:31.907855 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:31.918876 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-88a9797b-2a9b-4aa2-851c-2af816e86999 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.276291 Sep 19 14:53:31.919691 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 75/160] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:31 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:32.945354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:32.946635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:32.955599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:32.956276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:32.956962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:32.958046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:32.958880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:32.959643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:33.124289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:33.132834 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-367ce328-a6d2-4ccd-8be2-0b28e1a089ad tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.191897 Sep 19 14:53:33.134009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 86/161] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:32 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:34.157857 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:34.159031 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:34.168149 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:34.171059 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:34.172343 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:34.173062 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:34.173522 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:34.173948 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:34.327900 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:34.337690 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-711371f3-cfac-4bb2-914f-193bdc4416fb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.184397 Sep 19 14:53:34.338653 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 76/162] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:34 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:35.360433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:35.361045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:35.368195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:35.368904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:35.369558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:35.370450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:35.370903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:35.371566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:35.515477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:35.524207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b6214d9d-86a4-4539-8f5e-8d17d32501f8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.167441 Sep 19 14:53:35.525060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 87/163] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:35 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:36.548368 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:36.549017 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:36.555031 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:36.555514 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:36.555981 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:36.557283 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:36.558656 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:36.559091 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:36.700341 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:36.708122 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-eac190eb-af4e-48ae-9f44-191099fac0ed tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.163709 Sep 19 14:53:36.708692 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 77/164] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:36 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:37.254961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:37.255451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:37.262105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:37.263077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:37.263674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.264392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:37.264949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:37.265533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.293242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:53:37.392904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e5b27809-2ed2-474b-b3e2-c9e3d55a108e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 204 len: 0 microversion: 2.1 time: 0.141855 Sep 19 14:53:37.393786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 88/165] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:37 2022] DELETE /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:53:37.403547 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:37.404448 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:37.414077 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:37.414789 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:37.415555 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.416847 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:37.417474 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:37.418103 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.574481 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:37.578208 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=100 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:37.584328 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-0fc54690-4fe1-484c-9f54-1f183b160f09 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1554 microversion: 2.1 time: 0.185902 Sep 19 14:53:37.586463 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 78/166] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:37 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:37.733077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:37.733772 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:37.740095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:37.740592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:37.741563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.742525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:37.743161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:37.743873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:37.893756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:37.901375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-119e31da-01d6-424d-aaa1-056d8f4dae6d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.173693 Sep 19 14:53:37.901945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 89/167] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:37 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:38.608422 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:38.609026 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:38.615109 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:38.615585 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:38.616073 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:38.616750 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:38.617192 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:38.617606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:38.753742 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:38.762695 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-1fdba964-0878-4cdf-87dd-495b269f09ec tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1554 microversion: 2.1 time: 0.158896 Sep 19 14:53:38.763270 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 79/168] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:38 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:38.925921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:38.926631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:38.934549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:38.935165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:38.935925 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:38.936668 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:38.937124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:38.937645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:39.071428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:39.079463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8f45d942-8f1a-4934-9166-2affae8db15e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.157861 Sep 19 14:53:39.080150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 90/169] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:38 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:39.786483 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:39.787110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:39.793772 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:39.794267 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:39.794702 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:39.795599 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:39.796104 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:39.796533 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:39.936471 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:39.945903 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-3134de2d-3f78-4f3f-93f3-83e33fa79c02 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1554 microversion: 2.1 time: 0.163224 Sep 19 14:53:39.946482 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 80/170] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:39 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:40.104791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.105634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.112150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.112765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.113270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.114047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.114569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.115063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.267519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:40.276325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4b177330-7831-4399-b2c2-9958d39b9157 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.177343 Sep 19 14:53:40.276914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 91/171] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:40 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:40.971764 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:40.972489 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:40.986188 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.987049 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.987551 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:40.988540 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:40.989027 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:40.989446 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:41.145851 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:41.165126 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e333dfe2-6e0c-4a8d-862b-685d3ed2bb79 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1554 microversion: 2.1 time: 0.199001 Sep 19 14:53:41.165720 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 81/172] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:40 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:41.301582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:41.304633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:41.313363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:41.314312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:41.315123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:41.316071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:41.316765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:41.318095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:41.348559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:41.507527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:41.522139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d6b64906-f1c0-4409-b51e-9960d8d12fc9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.225567 Sep 19 14:53:41.523175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 92/173] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:41 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:42.188973 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:42.189697 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:42.199552 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.202562 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.203616 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.204679 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.205346 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.205921 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.545381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:42.546083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:42.564984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.566372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.567205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.570068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:42.572408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:42.577473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:42.620367 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:42.642130 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-2e6e0fcd-c73a-46b4-b0b9-24779757c45d tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1554 microversion: 2.1 time: 0.456285 Sep 19 14:53:42.642985 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 82/174] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:42 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1554 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:42.892219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:42.919982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-23e5495d-ca71-48cf-867a-2cf42a530b3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.378345 Sep 19 14:53:42.924643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 93/175] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:42 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:43.246273 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-dbf246c0-a67d-4a1d-8b9e-43053ab6fe8f req-f4807e58-894e-42e3-9c1f-dd0b65a6bed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aef9202-211a-4866-bf76-72c706512a32", "name": "network-vif-deleted", "tag": "9432a444-6a2d-4193-b1fc-67c4974a9173"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:43.265445 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-dbf246c0-a67d-4a1d-8b9e-43053ab6fe8f req-f4807e58-894e-42e3-9c1f-dd0b65a6bed6 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:43.268549 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-dbf246c0-a67d-4a1d-8b9e-43053ab6fe8f req-f4807e58-894e-42e3-9c1f-dd0b65a6bed6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:43.269182 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-dbf246c0-a67d-4a1d-8b9e-43053ab6fe8f req-f4807e58-894e-42e3-9c1f-dd0b65a6bed6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:43.298803 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-dbf246c0-a67d-4a1d-8b9e-43053ab6fe8f req-f4807e58-894e-42e3-9c1f-dd0b65a6bed6 service nova] Creating event network-vif-deleted:9432a444-6a2d-4193-b1fc-67c4974a9173 for instance 7aef9202-211a-4866-bf76-72c706512a32 on hv-cinder-75670 Sep 19 14:53:43.315270 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-dbf246c0-a67d-4a1d-8b9e-43053ab6fe8f req-f4807e58-894e-42e3-9c1f-dd0b65a6bed6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078694 Sep 19 14:53:43.316606 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 83/176] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:53:43.670521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:43.670884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:43.697002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:43.697554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:43.698019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:43.698785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:43.699236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:43.699661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:43.954465 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:43.956294 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:43.978906 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:43.979593 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:43.981284 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:43.983482 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:43.988343 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:43.989563 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:44.173812 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:44.190160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bef9603d-1181-47ca-8e25-89fd6e553bcc tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1346 microversion: 2.1 time: 0.523106 Sep 19 14:53:44.191418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 94/177] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:43 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1346 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:44.416893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:44.441877 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-440dee4a-1d52-48cc-8466-62a7f20225ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.494361 Sep 19 14:53:44.456863 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 84/178] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:43 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:45.227454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:45.229027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:45.243761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.244693 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.245262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.246575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.247124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.249244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.291990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.292656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.293254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.293878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lazy-loading 'fault' on Instance uuid 7aef9202-211a-4866-bf76-72c706512a32 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:45.386062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:45.395859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-08aa59b9-2a1a-4af2-bded-5f5a91e2358e tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1351 microversion: 2.1 time: 0.172086 Sep 19 14:53:45.411921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 95/179] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:45 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:45.486145 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:45.487873 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:45.498397 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.498892 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.499652 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.500429 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:45.500893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:45.501318 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:45.658693 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:45.668870 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e5f5fe50-1bee-4441-805b-c096e436659d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.188813 Sep 19 14:53:45.670193 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 85/180] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:45 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:46.427515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:46.428837 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:46.437732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.439809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.441414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.445445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.445938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.446378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.479381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.479892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.480327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.480783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lazy-loading 'fault' on Instance uuid 7aef9202-211a-4866-bf76-72c706512a32 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:53:46.527687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b775647ffb4500911c8ec8cf2ec804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0009b7d4f2545ffab964938384d40b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:46.539332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-67f3b0a5-89fd-4227-a6c5-f563eefe142f tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 200 len: 1351 microversion: 2.1 time: 0.118437 Sep 19 14:53:46.540081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 96/181] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:46 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:46.697136 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:46.698851 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:46.708828 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.710006 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.710603 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.711808 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:46.712293 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:46.712721 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:46.914897 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:46.925250 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-7eafeee6-ddd5-4858-9eb1-30405d75ea09 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.234651 Sep 19 14:53:46.925852 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 86/182] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:46 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:47.564825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:47.565308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:47.573781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.574631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.575453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.576368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.577069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.577669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.595815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] HTTP exception thrown: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Request method failure captured: Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 HTTP/1.1 Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII3vPW0cxDG2ZFE0z3xJIhnpvR4I_FSMB1_RyRdhoJiF-75HW_ka8i0aW1RE3_0AGLLavF644WAElLEggcl2a2qZIF7q_igfknwWHm9YN4e1A8zflfWNtCneeJ9Mpb4v3KX9LzqElYeQ3ClTq0JKWq9GgAKmMCUrRYzn3KIsNTFJIg Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:53:47.607027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0009b7d4f2545ffab964938384d40b6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 49b775647ffb4500911c8ec8cf2ec804 Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.608711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '7aef9202-211a-4866-bf76-72c706512a32'} Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:47.609477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.610764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.613725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Returning 404 to user: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:47.614951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fa37c076-c518-4640-8050-c636d838d7b7 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 404 len: 111 microversion: 2.1 time: 0.054978 Sep 19 14:53:47.616611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 97/183] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:47 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:53:47.757026 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:47.759065 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:47.770770 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.774399 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.775381 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.777634 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.782201 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.782940 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.799202 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.wsgi [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] HTTP exception thrown: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Request method failure captured: Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: request: GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32/os-volume_attachments HTTP/1.1 Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Accept: application/json Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Accept-Encoding: identity Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Connection: close Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Content-Length: 0 Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Content-Type: application/json Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Host: 10.222.0.60 Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Openstack-System-Scope: None Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Auth-Token: gAAAAABjKII3vPW0cxDG2ZFE0z3xJIhnpvR4I_FSMB1_RyRdhoJiF-75HW_ka8i0aW1RE3_0AGLLavF644WAElLEggcl2a2qZIF7q_igfknwWHm9YN4e1A8zflfWNtCneeJ9Mpb4v3KX9LzqElYeQ3ClTq0JKWq9GgAKmMCUrRYzn3KIsNTFJIg Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Domain-Id: None Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Domain-Name: None Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Identity-Status: Confirmed Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Is-Admin-Project: True Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Domain-Id: default Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Domain-Name: Default Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Role: member,reader Sep 19 14:53:47.812726 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Roles: member,reader Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0009b7d4f2545ffab964938384d40b6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Tenant: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Tenant-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Domain-Id: default Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Domain-Name: Default Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Id: 49b775647ffb4500911c8ec8cf2ec804 Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Name: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: method: > Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: exception: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.814174 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: action_args: {'server_id': '7aef9202-211a-4866-bf76-72c706512a32'} Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:47.814980 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:47.816395 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:47.821302 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Returning 404 to user: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. {{(pid=126869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:47.823880 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-723f8b2d-22be-43ca-87fc-f61f4e39885c tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071450 Sep 19 14:53:47.825191 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 87/184] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:53:47 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:47.956660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:47.957742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:47.973948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.974936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.975369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:47.976093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:47.985775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:47.986341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:48.473033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:48.486533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-25970384-2605-472c-897c-4b9661d04ecd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.534365 Sep 19 14:53:48.487603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 98/185] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:47 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:49.396411 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:49.397547 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:49.405800 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.406537 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.407066 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.408026 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.408695 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.409347 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.451229 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.wsgi [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] HTTP exception thrown: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Request method failure captured: Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: request: DELETE /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 HTTP/1.1 Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Accept: application/json Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Accept-Encoding: identity Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Connection: close Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Content-Length: 0 Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Content-Type: application/json Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Host: 10.222.0.60 Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Openstack-System-Scope: None Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Auth-Token: gAAAAABjKII3vPW0cxDG2ZFE0z3xJIhnpvR4I_FSMB1_RyRdhoJiF-75HW_ka8i0aW1RE3_0AGLLavF644WAElLEggcl2a2qZIF7q_igfknwWHm9YN4e1A8zflfWNtCneeJ9Mpb4v3KX9LzqElYeQ3ClTq0JKWq9GgAKmMCUrRYzn3KIsNTFJIg Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Domain-Id: None Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Domain-Name: None Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Identity-Status: Confirmed Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Is-Admin-Project: True Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Domain-Id: default Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Domain-Name: Default Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Project-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Role: member,reader Sep 19 14:53:49.454536 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Roles: member,reader Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0009b7d4f2545ffab964938384d40b6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Tenant: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Tenant-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Domain-Id: default Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Domain-Name: Default Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Id: 49b775647ffb4500911c8ec8cf2ec804 Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: X-User-Name: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: method: > Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: exception: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.455761 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: action_args: {'id': '7aef9202-211a-4866-bf76-72c706512a32'} Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:49.456572 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.457642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.460739 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Returning 404 to user: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. {{(pid=126869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:49.462038 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-9048adfd-f32c-4a83-8f00-9b058459bc0a tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 404 len: 111 microversion: 2.1 time: 0.077710 Sep 19 14:53:49.462612 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 88/186] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:53:49 2022] DELETE /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:49.473164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:49.474536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] [instance: 7aef9202-211a-4866-bf76-72c706512a32] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:49.488518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.489350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.491928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.493214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.493892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.497961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.511769 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:49.512719 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:49.520962 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.522195 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.527273 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.528421 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:49.529158 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:49.529411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] HTTP exception thrown: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.530080 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Request method failure captured: Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 HTTP/1.1 Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII3vPW0cxDG2ZFE0z3xJIhnpvR4I_FSMB1_RyRdhoJiF-75HW_ka8i0aW1RE3_0AGLLavF644WAElLEggcl2a2qZIF7q_igfknwWHm9YN4e1A8zflfWNtCneeJ9Mpb4v3KX9LzqElYeQ3ClTq0JKWq9GgAKmMCUrRYzn3KIsNTFJIg Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:53:49.531131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a0009b7d4f2545ffab964938384d40b6", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a0009b7d4f2545ffab964938384d40b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: a0009b7d4f2545ffab964938384d40b6 Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1595741805 Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 49b775647ffb4500911c8ec8cf2ec804 Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-DeleteServersTestJSON-1595741805-project Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.532356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '7aef9202-211a-4866-bf76-72c706512a32'} Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:53:49.533047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. Sep 19 14:53:49.534188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:53:49.535143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] Returning 404 to user: Instance 7aef9202-211a-4866-bf76-72c706512a32 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:53:49.535143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b04f26c9-be17-498e-9cb9-919bc251c402 tempest-DeleteServersTestJSON-1595741805 tempest-DeleteServersTestJSON-1595741805-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32" status: 404 len: 111 microversion: 2.1 time: 0.064772 Sep 19 14:53:49.535143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 99/187] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:49 2022] GET /compute/v2.1/servers/7aef9202-211a-4866-bf76-72c706512a32 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:53:49.848370 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:49.860549 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e1b0ea15-dd93-45ee-8223-51e2e0b0cb24 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.353031 Sep 19 14:53:49.873214 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 89/188] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:49 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:53:50.898320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:50.899316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:50.916272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:53:50.928432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.929463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.931748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:50.934560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:50.935404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:50.938762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:51.621191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:51.654287 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-94f1c9e0-9b7c-4c31-92fe-0ca026bc04c3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.765940 Sep 19 14:53:51.658074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 100/189] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:50 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:52.695044 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:52.696464 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:52.725381 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.725763 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.726333 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:52.726904 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:52.730471 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:52.730758 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:53.282102 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:53.293279 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e712156f-46e1-4a7b-8f61-f644e301c8f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.615278 Sep 19 14:53:53.293868 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 90/190] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:52 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:54.180127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-50314488-9794-47d7-b676-ecd1a5e38ef0 tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] Action: 'create', calling method: .version_select at 0x7f9f39b2cca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2004629993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdJjgui3BeRWoeZer435ZVto1RejDSuoIAf8idTvJP7RIHEaF4ZiQfTa2j9OW1njlFdaox/9YpMGX+NdFMfz4lbrYk+bjuVJ9Azr+0U0tlalLlgeMsGbU4rum/0KZHHlQ=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:53:54.200414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-50314488-9794-47d7-b676-ecd1a5e38ef0 tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] Getting quotas for project 5a6e2209a3a3487a9d6a7255cbe56b63. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:53:54.205436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-50314488-9794-47d7-b676-ecd1a5e38ef0 tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] Getting quotas for user 218c699b6ddd43a4bcf9b842c59445f5 and project 5a6e2209a3a3487a9d6a7255cbe56b63. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:53:54.248766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-50314488-9794-47d7-b676-ecd1a5e38ef0 tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.367651 Sep 19 14:53:54.250216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 101/191] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:53:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:53:54.317530 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:54.318211 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:54.331234 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:54.331791 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:54.332268 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:54.333008 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:54.333550 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:54.334015 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:54.881641 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:54.890343 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-37b85bb1-0a52-4400-9cb7-de59936eb958 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.576296 Sep 19 14:53:54.892083 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 91/192] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:54 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:55.918641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:55.919248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:55.934122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:55.934639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:55.935086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:55.935806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:55.936906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:55.941666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:56.386506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:56.399698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6cb261f8-b047-45f2-b793-9b1baf152db4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.485986 Sep 19 14:53:56.400952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 102/193] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:55 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:57.427051 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:57.428704 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:57.436845 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:57.437391 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:57.438047 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.438826 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:57.439491 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:57.440169 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:57.658245 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:57.671510 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-58500d45-9765-484c-8a64-8f6fea4e613b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.244300 Sep 19 14:53:57.671510 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 92/194] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:57 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:58.694291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:58.694829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:58.702248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:58.702744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:58.703185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:58.703917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:58.705116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:58.705825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:58.902546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:53:58.914716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b66f126c-368f-4703-8880-5c7ee14c6417 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.224874 Sep 19 14:53:58.915927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 103/195] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:58 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:53:59.946998 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:53:59.950665 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:53:59.981571 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.982180 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.983249 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:53:59.984774 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:53:59.992387 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:53:59.994580 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:00.389430 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:00.398721 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-11945c88-087c-4902-bd97-7f39d43c2a34 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.459779 Sep 19 14:54:00.399705 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 93/196] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:53:59 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:01.429049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:01.429792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:01.437446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.438129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.438897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.439855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:01.440461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:01.441173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:01.939678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:01.951208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0d4399a3-a809-4b48-b44b-3673f356966b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1522 microversion: 2.1 time: 0.528001 Sep 19 14:54:01.952036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 104/197] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:01 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:02.980164 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:02.981326 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:03.009893 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_api:SELECT=38 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:03.012451 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.013581 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.014624 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.016144 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.017110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.018150 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.288222 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:03.297401 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-444c5a87-cebb-4bad-a18f-ed705b098697 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1502 microversion: 2.1 time: 0.324295 Sep 19 14:54:03.298721 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 94/198] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:02 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:03.324331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:03.324989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:03.340635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.341778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.342752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.343902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:03.344653 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:03.346421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:03.664040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:03.678515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-43d0cc02-1e37-4c83-b6d0-05f38a825ca9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1517 microversion: 2.1 time: 0.359130 Sep 19 14:54:03.679328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 105/199] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:03 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:04.370267 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-1a46f843-7426-42f2-a93f-6dd53080b1cb tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: .version_select at 0x7f9f39b2a8b0>, body: {"keypair": {"name": "tempest-keypair-1913209802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoW0/OT9eXKDWpPjdh8efLXW+AWu+kId6zjxeTRQWwwd8pdX0wEf6+FhNd9tBDwJWbqx6db1NiVaV7HpJ6Hqg37YTvIIjcY7yV1sGYwLdTBSemfAl+zeLkgvZUiFxG4Aw=="}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:04.398654 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-1a46f843-7426-42f2-a93f-6dd53080b1cb tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for project 9a431be4c2f247e2955883eab6a5f555. Resources: {'key_pairs'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:04.403110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-1a46f843-7426-42f2-a93f-6dd53080b1cb tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for user 73ef9d62f31d4135b6f079a26d791ca5 and project 9a431be4c2f247e2955883eab6a5f555. Resources: {'key_pairs'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:04.431094 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-1a46f843-7426-42f2-a93f-6dd53080b1cb tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232337 Sep 19 14:54:04.432541 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 95/200] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:54:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:05.394770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:05.397709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:05.399582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:05.419383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.419900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.420335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.422865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.423492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.424093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.669337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'flavor' on Instance uuid a0c3dc74-07a1-4032-88cd-fae46c1e9f70 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:54:05.805262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-292af500-0ccb-4aaa-a101-fd3068e5c005 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/action" status: 200 len: 32 microversion: 2.1 time: 0.416607 Sep 19 14:54:05.805882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 106/201] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:54:05 2022] POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:54:05.816498 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:05.817716 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:05.824946 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.825677 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.826111 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:05.826966 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:05.827537 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:05.828074 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:06.089208 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:06.103735 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-c9202a26-b4ca-4041-94b1-f03abef2354e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.290752 Sep 19 14:54:06.118918 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 96/202] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:05 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:06.373839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-816183565", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "496537bd-479b-43b1-a831-0aca8c81649e"}], "security_groups": [{"name": "tempest-securitygroup--949615575"}], "key_name": "tempest-keypair-1913209802", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:06.538448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] validate_networks() for [('496537bd-479b-43b1-a831-0aca8c81649e', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:07.100252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:07.100796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:07.101674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:07.102374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:07.102798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:07.115698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.124540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.125278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.126321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.126997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.127604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.131188 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:07.131901 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:07.141475 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.142661 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.143289 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.144987 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:07.145971 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:07.147339 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:07.178121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for project 9a431be4c2f247e2955883eab6a5f555. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:07.186116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for user 73ef9d62f31d4135b6f079a26d791ca5 and project 9a431be4c2f247e2955883eab6a5f555. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:07.201391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:07.205702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:07.275482 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bc587a65-5536-4b49-a7cd-7aceecd48e27 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.906695 Sep 19 14:54:07.276665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 107/203] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:07.289185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c4d53d9c-a6e0-408f-ae65-a6d022419321 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:07.290132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c4d53d9c-a6e0-408f-ae65-a6d022419321 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:07.343388 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:07.354574 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e6f82a9d-b32b-457c-b0c8-29d6ce30d3c2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.230298 Sep 19 14:54:07.372940 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 97/204] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:07 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:07.386269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c4d53d9c-a6e0-408f-ae65-a6d022419321 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:07.397290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c4d53d9c-a6e0-408f-ae65-a6d022419321 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1237 microversion: 2.1 time: 0.111895 Sep 19 14:54:07.403939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 108/205] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:07 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:08.383091 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:08.384335 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:08.391877 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:08.392560 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:08.393577 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:08.394598 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:08.395215 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:08.396604 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:08.423615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:08.424262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:08.437754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:08.438341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:08.441551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:08.442334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:08.442850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:08.443288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:08.445016 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=100 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:08.584699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:08.597677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dac474b9-543b-49a0-8c9d-c2b05dfc40f0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1289 microversion: 2.1 time: 0.178749 Sep 19 14:54:08.598776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 109/206] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:08 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:08.670260 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:08.678656 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f41d782c-a603-4d40-9665-62eed24eb66d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.301724 Sep 19 14:54:08.680155 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 98/207] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:08 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:09.622610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:09.625029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:09.632401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:09.632900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:09.633335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:09.634487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:09.634898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:09.635511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:09.640585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:09.704696 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:09.705586 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:09.714620 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:09.715124 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:09.716059 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:09.716982 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:09.717657 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:09.718347 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:09.753803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:09.776934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-00035bf4-ca19-47cb-ace4-28831770c05d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1295 microversion: 2.1 time: 0.158110 Sep 19 14:54:09.784538 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 110/208] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:09 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1295 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:09.900613 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:09.908966 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-aa7474fa-6f62-4e56-a29b-b67d7bfca2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.209088 Sep 19 14:54:09.909873 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 99/209] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:09 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:10.800463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:10.801231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:10.810146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.810856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.811548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.812502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.813100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.814063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.937195 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:10.938546 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:10.946961 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.947934 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.949048 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:10.949929 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:10.950564 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:10.951171 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.066673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.089665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6ee29c51-da2d-4aae-8321-9abab9dacf50 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1362 microversion: 2.1 time: 0.286208 Sep 19 14:54:11.110132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 111/210] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:10 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:11.116358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-b0938bfd-7375-411b-a9db-9e68340ba5c6 req-e9fa4b3f-71b4-4b49-8206-07d51b90c34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41656a6-4409-4e9a-9b29-066443ea6426", "tag": "0dd476b1-5ace-4b09-be4d-ba06ef204d1e"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:11.127344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-b0938bfd-7375-411b-a9db-9e68340ba5c6 req-e9fa4b3f-71b4-4b49-8206-07d51b90c34e service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:11.128045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-b0938bfd-7375-411b-a9db-9e68340ba5c6 req-e9fa4b3f-71b4-4b49-8206-07d51b90c34e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:11.130900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-b0938bfd-7375-411b-a9db-9e68340ba5c6 req-e9fa4b3f-71b4-4b49-8206-07d51b90c34e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:11.137755 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:11.147216 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-095dee30-9fd3-444a-82a6-79396545ef5f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.214526 Sep 19 14:54:11.148000 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 100/211] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:10 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:11.148765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-b0938bfd-7375-411b-a9db-9e68340ba5c6 req-e9fa4b3f-71b4-4b49-8206-07d51b90c34e service nova] Creating event network-changed:0dd476b1-5ace-4b09-be4d-ba06ef204d1e for instance f41656a6-4409-4e9a-9b29-066443ea6426 on hv-cinder-75670 Sep 19 14:54:11.154129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-b0938bfd-7375-411b-a9db-9e68340ba5c6 req-e9fa4b3f-71b4-4b49-8206-07d51b90c34e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042324 Sep 19 14:54:11.154721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 112/212] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:12.117483 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:12.118105 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:12.124460 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.125095 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.125539 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.126362 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.126680 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.127083 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.171099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:12.172026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:12.178992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.179527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.179983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.180762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:12.181792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:12.182426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:12.262792 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:12.271390 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-f4641c18-a259-451f-8c0d-fe74b033e223 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1362 microversion: 2.1 time: 0.157713 Sep 19 14:54:12.272166 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 101/213] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:12 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:12.313855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:12.321504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-acae2a4f-74e6-4925-a584-64aa0234e032 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.154751 Sep 19 14:54:12.322428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 113/214] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:12 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:12.862778 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1188135969", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452"}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:12.921664 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.network.neutron [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] validate_networks() for None {{(pid=126869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:13.198594 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Flavor limits 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:13.199181 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Image limits 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:13.199466 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Flavor pref 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:13.199909 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Image pref 0:0:0 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:13.200347 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.virt.hardware [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:13.209014 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.209493 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.209925 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.210643 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.211091 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.211512 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.228189 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Getting quotas for project 431f4daf59224848a25db385c7541c95. Resources: {'instances', 'ram', 'cores'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:13.232072 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.quota [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Getting quotas for user f6485aba952244fcac8d0898e229bc83 and project 431f4daf59224848a25db385c7541c95. Resources: {'instances', 'ram', 'cores'} {{(pid=126869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:13.243317 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Going to run 1 instances... {{(pid=126869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:13.245615 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:13.293658 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-4632acfb-5a9a-4dbb-9a66-de7ff12e0556 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435298 Sep 19 14:54:13.294629 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 102/215] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:13.294756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:13.295567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:13.303773 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.304439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.304940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.305697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.306706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.307275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.308293 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-967173ad-eebf-4806-a04a-a35478df7baa tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:13.309149 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-967173ad-eebf-4806-a04a-a35478df7baa tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:13.383609 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-967173ad-eebf-4806-a04a-a35478df7baa tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.391584 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-967173ad-eebf-4806-a04a-a35478df7baa tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1215 microversion: 2.1 time: 0.089961 Sep 19 14:54:13.392834 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 103/216] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:13 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:13.397513 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:13.398286 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:13.405568 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.406213 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.406809 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.407695 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:13.408402 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:13.408984 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:13.479478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.489661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d792cc0c-cbb5-4bcd-820c-119eca130cd9 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1362 microversion: 2.1 time: 0.198813 Sep 19 14:54:13.504676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 114/217] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:13 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:13.558227 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:13.566136 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-cc7d7f9d-0b1b-4674-8497-32f4febf63ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.172321 Sep 19 14:54:13.566706 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 104/218] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:13 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:14.418686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:14.419284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:14.425833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.426310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.426739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.428068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.428455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.428869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.494050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:14.501789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fbd164d6-9258-4aad-8174-175fe60ccd68 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1267 microversion: 2.1 time: 0.087140 Sep 19 14:54:14.502362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 115/219] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:14 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:14.515956 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:14.515956 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:14.520461 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.520990 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.521424 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.522120 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.522578 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.523011 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.589412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:14.590122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:14.596067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.596664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.597147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.597905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:14.598424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:14.599320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:14.657559 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:14.666812 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-b33990e5-530d-4887-b1eb-91f617bab621 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1362 microversion: 2.1 time: 0.156662 Sep 19 14:54:14.683671 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 105/220] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:14 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:14.741343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:14.749384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-18458f4b-94b8-42ac-94ac-5f5a27d6b7fe tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.163662 Sep 19 14:54:14.749906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 116/221] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:14 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:15.526464 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:15.526991 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:15.532803 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.533279 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.533705 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.534378 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.534820 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.535242 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.598516 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.606299 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-1982f612-72fc-406c-9f84-3e59690de0ba tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1273 microversion: 2.1 time: 0.083747 Sep 19 14:54:15.606861 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 106/222] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:15 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:15.691934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:15.693999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:15.702097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.702521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.702975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.703839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.704329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.704787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.773153 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:15.774019 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:15.780713 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.781343 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.781916 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.782841 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:15.783618 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:15.784070 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:15.926765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.935202 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:15.949048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-415f5e6c-29e4-4edb-8062-fc3b36cc1a1f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1362 microversion: 2.1 time: 0.262123 Sep 19 14:54:15.950148 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-249031ba-8648-49d0-9129-48ea10da3d3e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.181847 Sep 19 14:54:15.950974 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 107/223] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:15 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:15.968529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 117/224] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:15 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:16.080277 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [req-77ec5dc6-7ccd-4a0a-9456-fa5d84e11dbe req-add9c7ef-c723-412e-ab3b-a16a42b793d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41656a6-4409-4e9a-9b29-066443ea6426", "name": "network-vif-plugged", "status": "completed", "tag": "0dd476b1-5ace-4b09-be4d-ba06ef204d1e"}]} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:16.090320 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-77ec5dc6-7ccd-4a0a-9456-fa5d84e11dbe req-add9c7ef-c723-412e-ab3b-a16a42b793d5 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.091024 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-77ec5dc6-7ccd-4a0a-9456-fa5d84e11dbe req-add9c7ef-c723-412e-ab3b-a16a42b793d5 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.091701 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [req-77ec5dc6-7ccd-4a0a-9456-fa5d84e11dbe req-add9c7ef-c723-412e-ab3b-a16a42b793d5 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.105296 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.compute.server_external_events [req-77ec5dc6-7ccd-4a0a-9456-fa5d84e11dbe req-add9c7ef-c723-412e-ab3b-a16a42b793d5 service nova] Creating event network-vif-plugged:0dd476b1-5ace-4b09-be4d-ba06ef204d1e for instance f41656a6-4409-4e9a-9b29-066443ea6426 on hv-cinder-75670 Sep 19 14:54:16.110537 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [req-77ec5dc6-7ccd-4a0a-9456-fa5d84e11dbe req-add9c7ef-c723-412e-ab3b-a16a42b793d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034129 Sep 19 14:54:16.111369 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 108/225] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:16.600130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-71134da5-85d4-45fb-8b35-f35f8dc23ae6 req-607874b0-c737-45a7-a4c0-80f4d3a45563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "853f7a47-7fb2-4ff0-9417-7d95a84901aa", "tag": "291f333b-110a-4ae1-a8fb-36e2988699ce"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:16.609630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-71134da5-85d4-45fb-8b35-f35f8dc23ae6 req-607874b0-c737-45a7-a4c0-80f4d3a45563 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.610105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-71134da5-85d4-45fb-8b35-f35f8dc23ae6 req-607874b0-c737-45a7-a4c0-80f4d3a45563 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.610536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-71134da5-85d4-45fb-8b35-f35f8dc23ae6 req-607874b0-c737-45a7-a4c0-80f4d3a45563 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.624368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-71134da5-85d4-45fb-8b35-f35f8dc23ae6 req-607874b0-c737-45a7-a4c0-80f4d3a45563 service nova] Creating event network-changed:291f333b-110a-4ae1-a8fb-36e2988699ce for instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa on hv-cinder-75670 Sep 19 14:54:16.629313 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-71134da5-85d4-45fb-8b35-f35f8dc23ae6 req-607874b0-c737-45a7-a4c0-80f4d3a45563 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Sep 19 14:54:16.630057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 118/226] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:16.630782 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:16.631633 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:16.638118 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.638594 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.639018 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.639702 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.640169 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.640581 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.780765 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:16.790227 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-e50493d7-7698-41bf-8533-584c1cb49c99 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.164226 Sep 19 14:54:16.790805 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 109/227] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:16 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:16.974814 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:16.975060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:16.975579 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.compute.api [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126869) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:16.976626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:16.981857 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.982354 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.982794 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.983114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.983494 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.983608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.984699 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.984838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.984921 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG oslo_concurrency.lockutils [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:16.984997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:16.985139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:16.985723 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.136666 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.policy [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126869) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.144534 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO nova.api.openstack.requestlog [None req-ecfb91f9-817a-4710-9b4c-90dcc3d29f6e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.173831 Sep 19 14:54:17.145114 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: [pid: 126869|app: 0|req: 110/228] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:16 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:17.154087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:17.178221 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.186149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6707d8f3-1e31-4129-944e-4dfedb7092fa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1362 microversion: 2.1 time: 0.215307 Sep 19 14:54:17.186711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 119/229] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:16 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:17.372110 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG nova.api.openstack.wsgi [None req-d9a3cabe-d2b5-4f9f-b98a-b490b40a16ce tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1976909239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2004629993", "security_groups": [{"name": "tempest-secgroup-smoke-179177056"}], "networks": [{"uuid": "5ee4790e-4200-4547-8c27-cac2a26e7673"}], "block_device_mapping_v2": [{"uuid": "991a8465-6abe-40cd-8ab0-479948e186c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:17.816768 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:17.817369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:17.819323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=8 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:17.825270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.825884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.826360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.827057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:17.827500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:17.827982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:17.955651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:17.963377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-111d6018-317f-4e2e-a6b5-32265dd5111e tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.150777 Sep 19 14:54:17.963970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 120/230] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:17 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:18.168829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:18.169442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:18.175783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.176300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.176742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.177497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.177998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.178430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.378743 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:18.386675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e03b4aac-14e8-4271-a1a8-8b43a54edad7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.221935 Sep 19 14:54:18.387244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 121/231] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:18 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:18.391885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:18.392492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:18.398925 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.399414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.399866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.400614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.401075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.401523 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.572447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:18.580108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ff067881-4785-4d49-8116-be354acf492a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1549 microversion: 2.1 time: 0.191901 Sep 19 14:54:18.580667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 122/232] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:18 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:18.602919 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:18.603403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:18.609051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.609531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.609961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.610640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.611087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.611505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.691323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-621bcdbe-cf81-4d92-b20a-7bc4bb93f2af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092298 Sep 19 14:54:18.691932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 123/233] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:54:18 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:18.986723 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:18.987333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:18.994260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.994749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.995188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:18.995964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:18.996492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:18.996924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.132387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:19.140416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-84a813ed-9d16-44f7-92d4-0de24a201402 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.157521 Sep 19 14:54:19.141008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 124/234] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:18 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:19.410347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:19.411046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:19.417983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.418540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.418963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.419678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.420234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.420604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.561801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:19.569519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5e1835b7-e1b7-4dce-b163-489639387080 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.163058 Sep 19 14:54:19.570095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 125/235] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:19 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:19.896407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-d24523ee-2566-41ce-b021-a9456133c7d4 req-20e0045c-537b-4ce5-9a7d-066617ed8257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41656a6-4409-4e9a-9b29-066443ea6426", "tag": "0dd476b1-5ace-4b09-be4d-ba06ef204d1e"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:19.906331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-d24523ee-2566-41ce-b021-a9456133c7d4 req-20e0045c-537b-4ce5-9a7d-066617ed8257 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:19.906901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-d24523ee-2566-41ce-b021-a9456133c7d4 req-20e0045c-537b-4ce5-9a7d-066617ed8257 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:19.907414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-d24523ee-2566-41ce-b021-a9456133c7d4 req-20e0045c-537b-4ce5-9a7d-066617ed8257 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:19.919692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-d24523ee-2566-41ce-b021-a9456133c7d4 req-20e0045c-537b-4ce5-9a7d-066617ed8257 service nova] Creating event network-changed:0dd476b1-5ace-4b09-be4d-ba06ef204d1e for instance f41656a6-4409-4e9a-9b29-066443ea6426 on hv-cinder-75670 Sep 19 14:54:19.924631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-d24523ee-2566-41ce-b021-a9456133c7d4 req-20e0045c-537b-4ce5-9a7d-066617ed8257 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032542 Sep 19 14:54:19.925305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 126/236] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:20.167496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:20.168235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:20.174983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.175472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.175928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.176632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.177137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.177557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.416593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.424983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3294cde7-af16-443a-a43c-086931426527 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.261747 Sep 19 14:54:20.425372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 127/237] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:20 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:20.593415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:20.594017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:20.599772 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.600293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.600726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.601420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:20.601869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:20.602292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:20.741501 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:20.749259 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b8a8cd16-5ff2-4c66-92fc-adfdfda269bf tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.159789 Sep 19 14:54:20.750024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 128/238] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:20 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:21.142709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.143209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.145203 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.151137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.151613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.152065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.152750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.153195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.153613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.158306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:21.186485 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-258bc857-e819-4cc7-b843-e0363dea48a6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/ips" status: 200 len: 152 microversion: 2.20 time: 0.047361 Sep 19 14:54:21.187535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 129/239] 10.222.0.60 () {60 vars in 1289 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:54:21.454674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.454674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.456537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.456951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.457437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.458434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.458942 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.459699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.606454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.614392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ddab129d-2b56-4bd7-b49e-21fed8dcc8cf tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.170465 Sep 19 14:54:21.614965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 130/240] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:21.772876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:21.773486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:21.779495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.780019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.780459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.781154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:21.781734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:21.782202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:21.918093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:21.927599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-454369c5-adc2-456b-bf00-5c92cf7245b0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.158683 Sep 19 14:54:21.928210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 131/241] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:21 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:22.039348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-e4c3f35e-b6b8-4ca0-9250-0928a5485fb9 req-e4247a02-7209-45a9-a45d-70dc173306e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "853f7a47-7fb2-4ff0-9417-7d95a84901aa", "name": "network-vif-plugged", "status": "completed", "tag": "291f333b-110a-4ae1-a8fb-36e2988699ce"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:22.049242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e4c3f35e-b6b8-4ca0-9250-0928a5485fb9 req-e4247a02-7209-45a9-a45d-70dc173306e3 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.049717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e4c3f35e-b6b8-4ca0-9250-0928a5485fb9 req-e4247a02-7209-45a9-a45d-70dc173306e3 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.050153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e4c3f35e-b6b8-4ca0-9250-0928a5485fb9 req-e4247a02-7209-45a9-a45d-70dc173306e3 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.062466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-e4c3f35e-b6b8-4ca0-9250-0928a5485fb9 req-e4247a02-7209-45a9-a45d-70dc173306e3 service nova] Creating event network-vif-plugged:291f333b-110a-4ae1-a8fb-36e2988699ce for instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa on hv-cinder-75670 Sep 19 14:54:22.067298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-e4c3f35e-b6b8-4ca0-9250-0928a5485fb9 req-e4247a02-7209-45a9-a45d-70dc173306e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031617 Sep 19 14:54:22.068574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 132/242] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:22.637931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.638624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.644759 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.645242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.646170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.646855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.647307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.647726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.780982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:22.790029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-874e068e-9761-45ef-9a42-5399169d8fff tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.156730 Sep 19 14:54:22.790525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 133/243] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:22.950571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:22.951174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:22.957339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.957820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.958899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:22.959578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:22.960065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:22.960487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.087355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.095156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-194f93e5-b4cc-4229-b975-7731fe53370c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.148452 Sep 19 14:54:23.095746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 134/244] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:22 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:23.219027 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell0:SELECT=2 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:23.315351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:23.315914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.322625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.323107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.323538 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.324255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.324705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.325126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.347534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lazy-loading 'flavor' on Instance uuid 7c86857b-a653-4c5f-97c0-643793ca4d35 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:54:23.391687 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell0:SELECT=12 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:23.534769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-029d16d0-83a6-49a2-99ba-a3edadeef2ec tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/action" status: 202 len: 0 microversion: 2.20 time: 0.223240 Sep 19 14:54:23.535362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 135/245] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Sep 19 14:54:23 2022] POST /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:54:23.543534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:23.544241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.550388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.550865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.551295 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.552003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.552945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.553364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.687115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.695236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.696775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.697988 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6fc86d41-c31d-41d4-ad3d-23303c98e22f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.158292 Sep 19 14:54:23.698603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 136/246] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:23.813488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:23.814053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:23.822256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.822752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.823182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.823920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:23.824392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:23.824811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:23.957531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:23.965102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-10a44de5-a9a4-490b-8e39-5cfc10ec01b3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1315 microversion: 2.1 time: 0.155512 Sep 19 14:54:23.965674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 137/247] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:23 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:24.117756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.118359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.124428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.124909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.125343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.126024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.126475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.126895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.257126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.264660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6f676d1a-2f67-4922-ae50-8bd9c8e0f43c tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.150871 Sep 19 14:54:24.265228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 138/248] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:24 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:24.527215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.527649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.533746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.534231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.534669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.535355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.535808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.536256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.559064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0b7baf37-15b0-4058-86af-93c7a7406533 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/ips" status: 200 len: 150 microversion: 2.1 time: 0.035878 Sep 19 14:54:24.559621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 139/249] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:54:24 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:24.724943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.725901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.732088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.732573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.733010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.733706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.734155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.734580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.874926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.886355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.888544 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:24.890500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-053d8b18-0536-4686-945f-9131f72b2f52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.170318 Sep 19 14:54:24.891146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 140/250] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:24 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:24.988358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:24.988971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:24.995752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.996282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.996722 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:24.997430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:24.997887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:24.998319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.128748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.136591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6bc78520-c8e5-4d53-afe6-7b7dcf053cb6 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1464 microversion: 2.1 time: 0.152015 Sep 19 14:54:25.137001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 141/251] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:24 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:25.186664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.187164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.194540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.195030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.195461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.196180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.196631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.197052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.224052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:54:25.300395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5c6ac25d-d564-44fa-be44-2cd4e18c2e36 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "DELETE /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 204 len: 0 microversion: 2.1 time: 0.118161 Sep 19 14:54:25.301251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 142/252] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:54:25 2022] DELETE /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:54:25.308499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.309217 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.315177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.315668 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.316154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.316887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.317347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.318310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.337434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:25.454024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.462310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7060cb5d-fd63-445f-ad91-e43ff8910c22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.159719 Sep 19 14:54:25.462874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 143/253] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:25.467253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.467870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.473442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.473980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.474457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.475146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.475601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.476048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.603501 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:25.611066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-866d5413-49a0-4f18-b3dd-dd71f567b74a tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1470 microversion: 2.1 time: 0.147256 Sep 19 14:54:25.611625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 144/254] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:25.916515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:25.917282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:25.923943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.924424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.924851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:25.925535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:25.925978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:25.926391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.059371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:26.067496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:26.069020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:26.070196 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b597626a-c631-434a-95e2-2c03c9363aaa tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.157758 Sep 19 14:54:26.070946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 145/255] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:25 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:26.075418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9a9d87c-76e6-4a98-bd72-5eb48e807b1c"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:26.077947 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.084181 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.084693 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.085133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.085841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.086296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.086719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.825873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-71ac5cd2-d2a4-494d-b678-f338615ff6ca tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753920 Sep 19 14:54:26.826477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 146/256] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:54:26 2022] POST /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:26.831471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.832187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.838609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.839099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.839541 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.840307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.840763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.841188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.975081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:26.983540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2f26eb75-8bbd-4d10-832f-b801923b2dd3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.155855 Sep 19 14:54:26.984144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 147/257] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:26.988783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:26.989386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:26.996579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.997076 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.997510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:26.998204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:26.998655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:26.999073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.141245 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_cell1:SELECT=60 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:27.238461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.246223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fe31703f-18b0-43bf-b1a5-9826f20a83f3 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1470 microversion: 2.1 time: 0.261073 Sep 19 14:54:27.246808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 148/258] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:26 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:27.251360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:27.252055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:27.258043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.258533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.258970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.259697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.260263 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.260688 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.385869 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: DEBUG dbcounter [-] [126869] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=126869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:27.455651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.464682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.466134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:27.467293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9dfda598-9ff4-42c2-8269-1efc511526fc tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.219573 Sep 19 14:54:27.468004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 149/259] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:27 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:27.673947 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-cb86c102-6156-4ef8-9f03-f3769a97eb6e req-0df8ad51-87c9-4c86-9e1e-cf3b4cbd83d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "853f7a47-7fb2-4ff0-9417-7d95a84901aa", "name": "network-vif-deleted", "tag": "291f333b-110a-4ae1-a8fb-36e2988699ce"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:27.684145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb86c102-6156-4ef8-9f03-f3769a97eb6e req-0df8ad51-87c9-4c86-9e1e-cf3b4cbd83d1 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:27.684546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb86c102-6156-4ef8-9f03-f3769a97eb6e req-0df8ad51-87c9-4c86-9e1e-cf3b4cbd83d1 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:27.684969 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb86c102-6156-4ef8-9f03-f3769a97eb6e req-0df8ad51-87c9-4c86-9e1e-cf3b4cbd83d1 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:27.698159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-cb86c102-6156-4ef8-9f03-f3769a97eb6e req-0df8ad51-87c9-4c86-9e1e-cf3b4cbd83d1 service nova] Creating event network-vif-deleted:291f333b-110a-4ae1-a8fb-36e2988699ce for instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa on hv-cinder-75670 Sep 19 14:54:27.704233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-cb86c102-6156-4ef8-9f03-f3769a97eb6e req-0df8ad51-87c9-4c86-9e1e-cf3b4cbd83d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033819 Sep 19 14:54:27.707859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 150/260] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:28.008401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:28.009087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.015567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.016067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.016505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.017186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.017630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.018048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.147301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.155027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a4e94956-c5da-47b0-8509-19e8851504df tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.152222 Sep 19 14:54:28.155588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 151/261] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:28 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:28.270974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:28.271565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.277528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.278008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.278444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.279232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.279853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.280195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.317660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.318147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.318601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.319041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lazy-loading 'fault' on Instance uuid 853f7a47-7fb2-4ff0-9417-7d95a84901aa {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:54:28.362732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6485aba952244fcac8d0898e229bc83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431f4daf59224848a25db385c7541c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.371796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4be84d7d-ed1c-4210-a788-d2854fd54876 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 200 len: 1305 microversion: 2.1 time: 0.106051 Sep 19 14:54:28.372691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 152/262] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:28 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:28.493331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:28.493938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:28.500452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.500933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.501365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.502058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:28.502601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:28.502934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:28.632827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.640933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.642365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:28.643509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8d9f3623-1823-425c-8395-715b5f732c76 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.155021 Sep 19 14:54:28.644085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 153/263] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:28 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:29.178454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:29.179128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:29.185809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.186298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.186735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.187433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.187916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.188348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.396673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:29.404544 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ad8aa2ef-a353-4aad-8f8a-b82025292ddd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.230039 Sep 19 14:54:29.405205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 154/264] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:29 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:29.409742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:29.410408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] [instance: 853f7a47-7fb2-4ff0-9417-7d95a84901aa] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:29.416987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.417753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.418118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.418891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.419461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.420038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.435357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] HTTP exception thrown: Instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa could not be found. Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Request method failure captured: Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa HTTP/1.1 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKTRb9J1ZVWmhGYbJqCK6dEF_i_4Nc9kfZx9KeBLCYOuD848U0XSjFLiHF94o1VEDsgpqyrukQfEmb51FlwcNoER7Ahsr6I9ePvkI7IdsDJ6RTt1VRA8zxJ0NXgrkeGYZ3bTrzSkppQEHEo3wi67eU_L-kG0RKniMA_-rlir8H1eE0 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 431f4daf59224848a25db385c7541c95 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-931028600 Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:54:29.437116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_431f4daf59224848a25db385c7541c95", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/431f4daf59224848a25db385c7541c95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/431f4daf59224848a25db385c7541c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/431f4daf59224848a25db385c7541c95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-931028600 Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 431f4daf59224848a25db385c7541c95 Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-931028600 Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-931028600-project Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: f6485aba952244fcac8d0898e229bc83 Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-931028600-project Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa could not be found. Sep 19 14:54:29.439530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '853f7a47-7fb2-4ff0-9417-7d95a84901aa'} Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa could not be found. Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:29.442057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa could not be found. Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa could not be found. Sep 19 14:54:29.445116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:29.447228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] Returning 404 to user: Instance 853f7a47-7fb2-4ff0-9417-7d95a84901aa could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:29.447228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-25efd676-88f9-4d3f-a20b-1dad46c6f386 tempest-VolumesNegativeTest-931028600 tempest-VolumesNegativeTest-931028600-project] 10.222.0.60 "GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa" status: 404 len: 111 microversion: 2.1 time: 0.032458 Sep 19 14:54:29.447228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 155/265] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:29 2022] GET /compute/v2.1/servers/853f7a47-7fb2-4ff0-9417-7d95a84901aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:54:29.670456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:29.671059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:29.676874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.677336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.678362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.679041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:29.679489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:29.679929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:29.830031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:29.838594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:29.840444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:29.841701 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7a536689-4b04-4b12-a6e6-a9b812cce2e2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.175068 Sep 19 14:54:29.842329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 156/266] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:29 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:30.426516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.427265 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:30.434449 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.434941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.435381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.436109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.436566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.436994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.575651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:30.585497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0cecf386-f55f-4f5d-a12d-72e11707748f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.162517 Sep 19 14:54:30.586543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 157/267] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:30.868463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:30.869066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:30.875131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.875608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.876062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:30.876753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:30.877216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:30.877617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.017465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.026237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.027777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.029080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2510a742-82b1-48c5-af36-dcc5f1ae294b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.165206 Sep 19 14:54:31.029696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 158/268] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:30 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:31.610685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:31.611357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:31.623780 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.624307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.624746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.625450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:31.625907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:31.626330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:31.759435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:31.763080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:31.768655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f8afc544-fff4-4e06-85c1-cd30fe8435fd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.162046 Sep 19 14:54:31.769331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 159/269] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:31 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:32.054958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:32.055574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:32.063348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.063861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.064304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.065007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.065464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.065890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.218606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:32.227444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:32.228955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:32.230125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f04be626-9c39-4880-b9b5-abb785139fc6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.179612 Sep 19 14:54:32.230679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 160/270] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:32 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:32.792926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:32.793568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:32.799974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.800464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.800900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.801587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:32.802042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:32.802470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:32.939332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:32.947106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-18592810-b645-44b3-9a06-b7c9eaddad2a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.158149 Sep 19 14:54:32.947669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 161/271] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:32 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:33.256224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:33.256952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:33.262917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.263393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.263836 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.264528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.264968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.265384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.399532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:33.408780 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:33.410229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:33.411380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6af4bf24-5c74-452f-af8e-a24e6052081a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.159305 Sep 19 14:54:33.411952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 162/272] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:33 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:33.969103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:33.970497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:33.978178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.978977 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.979623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:33.980681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:33.981487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:33.981934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.135431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:34.143278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e2308492-7332-4623-8478-6ca880b201af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.177902 Sep 19 14:54:34.143774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 163/273] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:33 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:34.405380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cfd36d5d-ab96-4ea0-8f3c-da661a479019 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: .version_select at 0x7f9f3a6e1d30>, body: {"keypair": {"name": "tempest-keypair-2103837273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrrKIRq4dOaVLdUapx8I3h30AhznPtn8PV9eTX02WoZQw2ElCS+ohu8hHM9w1BTNsu1nRuIzW+TuDMNsNFJXhdlB6OhI9fjl0lzdqPTuHmSH1oNhlgcDlPMnQZjiAWHSQ=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:34.422346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-cfd36d5d-ab96-4ea0-8f3c-da661a479019 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:34.426269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-cfd36d5d-ab96-4ea0-8f3c-da661a479019 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:34.450146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cfd36d5d-ab96-4ea0-8f3c-da661a479019 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048604 Sep 19 14:54:34.450935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 164/274] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:54:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:34.455713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:34.456431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:34.463863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:34.464359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:34.464800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.465537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:34.465997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:34.466421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:34.654643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:34.665004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:34.666471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:34.667713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-eae44d78-89fe-46a4-80da-2d34652eef99 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.215867 Sep 19 14:54:34.679857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 165/275] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:34 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:35.166661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:35.167645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:35.174202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:35.174599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:35.175245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:35.176003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:35.176466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:35.176898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:35.445355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:35.454986 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b311f316-d7ca-4fe2-90f3-e8c62052d5ee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.292161 Sep 19 14:54:35.462751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 166/276] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:35 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:35.694533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:35.695347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:35.711484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:35.712306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:35.714480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:35.716462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:35.719092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:35.719625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:35.968721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:35.978474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:35.980144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:35.981630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-783f44c6-2c16-4eea-837c-d9e8ae1bdd61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.291007 Sep 19 14:54:35.982720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 167/277] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:35 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:36.401840 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1244344516", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be7d8aa6-9b4b-4d6b-91e8-89101b447c76"}], "security_groups": [{"name": "tempest-securitygroup--1345225945"}], "key_name": "tempest-keypair-2103837273", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:36.506404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] validate_networks() for [('be7d8aa6-9b4b-4d6b-91e8-89101b447c76', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:36.877827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:36.878257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:36.878736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:36.879190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:36.879611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:36.881590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:36.890349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.890832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.891268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.892025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.892485 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.892915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.911781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:36.917219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:36.930563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:36.933894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:36.980830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-76f8e1b3-b15c-4044-b1ee-fd1e7b700f00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583972 Sep 19 14:54:36.981476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 168/278] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:54:36.986058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:36.986572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:36.993265 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.993751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.994863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:36.995553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:36.996060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:36.996908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.135735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:37.145270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f7eb209a-c732-47c4-bb35-251dd549c669 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1503 microversion: 2.1 time: 0.161373 Sep 19 14:54:37.145270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 169/279] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:36 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:37.156054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2a2c7d10-bead-468a-b9e3-82789aed8832 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:37.160562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2a2c7d10-bead-468a-b9e3-82789aed8832 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:37.220861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2a2c7d10-bead-468a-b9e3-82789aed8832 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:37.232318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2a2c7d10-bead-468a-b9e3-82789aed8832 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1242 microversion: 2.1 time: 0.085994 Sep 19 14:54:37.233455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 170/280] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:37 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:37.240471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:37.241535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:37.261106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.261668 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.262052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.262998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.263252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.263709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.408208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:37.418362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:37.420461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:37.421616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1d42d12a-e2f4-43c3-b956-60e611df553c tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.186411 Sep 19 14:54:37.422168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 171/281] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:37 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:37.426837 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f5df89d-e396-4ab5-98a8-77626fd916a5"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:37.430985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:37.441091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.441621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.442094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.443648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.444134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.445024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.470278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] HTTP exception thrown: Cannot 'attach_volume' instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 while it is in vm_state rescued Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Request method failure captured: Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/os-volume_attachments HTTP/1.1 Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 74 Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIupeH_kuHISBrwHOUes8TECc-yxkq7b0k3DfsWggDcApN4As7X5NzdGOoPirf2u3aPbJvApSy3DvooofC8KEV4NI5rcW5jEkWYQIM7pZDnZpnJf_mRnNsu3-t8RbAU_CzK_dNp42W3_VdekEppHEJ5_n4Rv8cZMzkSm_fGMP7mlmU Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:54:37.472385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73c223bd20fc43eca4c1cd0921f7906d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 1cccf354894c4311b7710d8a65682eeb Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {"volumeAttachment": {"volumeId": "1f5df89d-e396-4ab5-98a8-77626fd916a5"}} Sep 19 14:54:37.473966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Cannot 'attach_volume' instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 while it is in vm_state rescued Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'server_id': 'a0c3dc74-07a1-4032-88cd-fae46c1e9f70', 'body': {'volumeAttachment': {'volumeId': '1f5df89d-e396-4ab5-98a8-77626fd916a5'}}} Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:54:37.474843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 while it is in vm_state rescued Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:54:37.476381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 while it is in vm_state rescued Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Returning 409 to user: Cannot 'attach_volume' instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 while it is in vm_state rescued {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c35ace51-49da-4566-a57e-2294f09db03f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050680 Sep 19 14:54:37.478841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 172/282] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:54:37 2022] POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:54:37.480489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-617283152", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "networks": [{"uuid": "0bda37ba-05ad-4638-bdea-6a00d9ba8c3e"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:37.534453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] validate_networks() for [('0bda37ba-05ad-4638-bdea-6a00d9ba8c3e', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:37.897438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:37.897854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:37.898489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:37.898903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:37.899311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:37.908629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.909148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.909671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.910472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:37.910921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:37.911338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:37.928297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Getting quotas for project aeec00f3a752480cb9ac3a670bcb297d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:37.932948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Getting quotas for user c0b677827f1648319b0616aec4db66e6 and project aeec00f3a752480cb9ac3a670bcb297d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:37.943493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:37.945707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:37.989632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a8683645-35b7-4a15-9857-705d24603420 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513942 Sep 19 14:54:37.990261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 173/283] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:37.997117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:37.997117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:38.002862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.003339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.003767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.004478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.004944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.005362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.075459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0b05f8e0-5b0b-4ef0-90a6-c670cd17265e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/action" status: 202 len: 0 microversion: 2.1 time: 0.083725 Sep 19 14:54:38.076323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 174/284] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:54:37 2022] POST /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:54:38.081624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bb2c0210-a52f-42a6-9790-12081c39f8a2 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:38.082326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bb2c0210-a52f-42a6-9790-12081c39f8a2 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:38.137102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bb2c0210-a52f-42a6-9790-12081c39f8a2 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:38.144325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bb2c0210-a52f-42a6-9790-12081c39f8a2 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1218 microversion: 2.1 time: 0.066970 Sep 19 14:54:38.144941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 175/285] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:38 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:38.150200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:38.150884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:38.157156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.157645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.158081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.158838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.159293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.159721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.488250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:38.497198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7a6e75e5-10bf-4160-8647-e18e32c69639 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1511 microversion: 2.1 time: 0.351278 Sep 19 14:54:38.497973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 176/286] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:38 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:38.502880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:38.503523 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:38.510226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.510904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.511499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.512398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.513007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.513586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.623425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:38.631903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-af2f5acf-1794-444b-895a-b5c836ecd09b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1300 microversion: 2.1 time: 0.132873 Sep 19 14:54:38.633130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 177/287] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:38 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:38.638420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:38.639140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:38.645121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.645883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.646424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.647385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:38.647974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:38.648685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:38.990220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:38.998791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:39.000284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:39.001453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-781c390a-af56-4854-8c29-1300fe36ba68 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.367163 Sep 19 14:54:39.002019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 178/288] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:38 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:39.167924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:39.168886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:39.175130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.175608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.176071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.176758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.177202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.177621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.251959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:39.261654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f7539f45-a003-48ef-8a89-eaaab22f6ef0 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1270 microversion: 2.1 time: 0.097848 Sep 19 14:54:39.262761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 179/289] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:39 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:39.522209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:39.523764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:39.538572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.544580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.545322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.546347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.547155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.547757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.555343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:39.914405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:39.925050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-713abd2d-7a06-4f4d-8e2c-0fa76095bb8a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1511 microversion: 2.1 time: 0.407195 Sep 19 14:54:39.946278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 180/290] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:39 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:39.951577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:39.952533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:39.959613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.960318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.961520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:39.962380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:39.962980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:39.963551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.204905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:40.220115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d053c8e6-2580-4417-9178-c81cdb5ff632 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.271825 Sep 19 14:54:40.222174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 181/291] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:39 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:40.230567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:40.231412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:40.240064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.240554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.240980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.241675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.243135 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.243580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.495004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:40.515192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:40.516673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:40.517886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-29f6e7df-8456-4d16-a0c4-875108b6c23a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1745 microversion: 2.20 time: 0.293286 Sep 19 14:54:40.519248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 182/292] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:40 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1745 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:40.525739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:40.527139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:40.534048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.534884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.535466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.536571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.537180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.537620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.941049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:40.948697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2b935a5b-a3e6-4675-a9b1-b21dc2722b58 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.429201 Sep 19 14:54:40.949276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 183/293] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:40 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:40.953715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:40.954325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:40.960096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.960578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.961182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:40.961871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:40.962342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:40.962752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.125564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.133754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-89d5b0c7-ea7d-442b-845a-26d10cc806c9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1511 microversion: 2.1 time: 0.183595 Sep 19 14:54:41.134312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 184/294] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:40 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:41.138643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-5f1b87cf-dc13-4a32-bc69-d31f3ae00397 req-d3032d4b-5428-4045-b1dd-48ece72aec27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4", "tag": "64ae02b1-c8f7-4ba2-b4ab-a4881fb44844"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:41.147529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5f1b87cf-dc13-4a32-bc69-d31f3ae00397 req-d3032d4b-5428-4045-b1dd-48ece72aec27 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.148042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5f1b87cf-dc13-4a32-bc69-d31f3ae00397 req-d3032d4b-5428-4045-b1dd-48ece72aec27 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.149169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5f1b87cf-dc13-4a32-bc69-d31f3ae00397 req-d3032d4b-5428-4045-b1dd-48ece72aec27 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.160152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-5f1b87cf-dc13-4a32-bc69-d31f3ae00397 req-d3032d4b-5428-4045-b1dd-48ece72aec27 service nova] Creating event network-changed:64ae02b1-c8f7-4ba2-b4ab-a4881fb44844 for instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 on hv-cinder-75670 Sep 19 14:54:41.165595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-5f1b87cf-dc13-4a32-bc69-d31f3ae00397 req-d3032d4b-5428-4045-b1dd-48ece72aec27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030062 Sep 19 14:54:41.166179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 185/295] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:41.244020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:41.244716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:41.251305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.251817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.252276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.252997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.253449 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.253896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.420582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.429948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d1cb087e-3309-4cef-999e-8d7e314bf2c7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.189862 Sep 19 14:54:41.434498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 186/296] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:41 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:41.544680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:41.545964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:41.552522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.553010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.553503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.554196 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.555131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.555554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.685483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.693531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.695475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:41.696664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-38c1cc20-9a9c-40c6-90be-3e78aec0de6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1745 microversion: 2.20 time: 0.156009 Sep 19 14:54:41.697224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 187/297] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:41 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:41.959597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-cd799bcd-1463-44a8-b6aa-2f9296d1123a req-d7f1b934-9272-4cb5-8e62-a928bfd94b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3bbf69f-e276-453b-aee8-f8d8234c7da0", "tag": "9cdde95d-df11-450d-b00f-3a77132d88c0"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:41.970082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cd799bcd-1463-44a8-b6aa-2f9296d1123a req-d7f1b934-9272-4cb5-8e62-a928bfd94b6e service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:41.970554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cd799bcd-1463-44a8-b6aa-2f9296d1123a req-d7f1b934-9272-4cb5-8e62-a928bfd94b6e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:41.970979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cd799bcd-1463-44a8-b6aa-2f9296d1123a req-d7f1b934-9272-4cb5-8e62-a928bfd94b6e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:41.982300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-cd799bcd-1463-44a8-b6aa-2f9296d1123a req-d7f1b934-9272-4cb5-8e62-a928bfd94b6e service nova] Creating event network-changed:9cdde95d-df11-450d-b00f-3a77132d88c0 for instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 on hv-cinder-75670 Sep 19 14:54:41.986904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-cd799bcd-1463-44a8-b6aa-2f9296d1123a req-d7f1b934-9272-4cb5-8e62-a928bfd94b6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031156 Sep 19 14:54:41.988026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 188/298] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:41.994728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:41.995572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.002359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.002842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.003270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.003990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.004608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.005021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.191158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.199536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4993ac55-635e-4574-89aa-5f913e040799 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.210196 Sep 19 14:54:42.200227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 189/299] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:41 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:42.204783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-68e31344-eec2-4769-b2e2-2c8dbf4f53b9 req-8c9242bc-7b23-4b37-9b69-8d9b956afb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "name": "network-vif-plugged", "status": "completed", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:42.214437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-68e31344-eec2-4769-b2e2-2c8dbf4f53b9 req-8c9242bc-7b23-4b37-9b69-8d9b956afb57 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.215137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-68e31344-eec2-4769-b2e2-2c8dbf4f53b9 req-8c9242bc-7b23-4b37-9b69-8d9b956afb57 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.215712 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-68e31344-eec2-4769-b2e2-2c8dbf4f53b9 req-8c9242bc-7b23-4b37-9b69-8d9b956afb57 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.227810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-68e31344-eec2-4769-b2e2-2c8dbf4f53b9 req-8c9242bc-7b23-4b37-9b69-8d9b956afb57 service nova] Creating event network-vif-plugged:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:54:42.232897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-68e31344-eec2-4769-b2e2-2c8dbf4f53b9 req-8c9242bc-7b23-4b37-9b69-8d9b956afb57 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Sep 19 14:54:42.233604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 190/300] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:42.238904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:42.239659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.249223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.249716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.250382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.251099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.251557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.252018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.497568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.506092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1f7a48df-1817-4c93-b356-a95fd0585416 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1517 microversion: 2.1 time: 0.271131 Sep 19 14:54:42.506673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 191/301] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:42 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:42.512726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:42.513339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.539276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.539776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.540276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.540985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.541444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.541869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.690235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.698515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2ce197c6-b524-45e8-a495-14c44dec686a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.189807 Sep 19 14:54:42.699183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 192/302] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:42 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:42.723080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:42.723699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:42.730173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.730659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.731097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.731793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:42.732342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:42.732767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:42.884416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.893094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.894555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:42.896110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1262fcda-1bc1-4808-b807-7e1c56455b58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1745 microversion: 2.20 time: 0.177133 Sep 19 14:54:42.896692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 193/303] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:42 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:43.223646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:43.224272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:43.230327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:43.230796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:43.231225 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:43.231935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:43.232384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:43.232794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:43.364769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:43.372971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f9ca14e7-76e4-4388-9737-5132e30e4407 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.153126 Sep 19 14:54:43.373551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 194/304] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:43 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:43.723311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:43.724115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:43.731035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:43.731654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:43.731993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:43.732895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:43.733348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:43.733930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.002298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.010204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4743ded8-9ba7-4d81-a5d9-664fdd6bb6e9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.291343 Sep 19 14:54:44.010880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 195/305] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:43 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:44.030458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0725641e-b784-4098-8b11-c2cb6126cad0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'create', calling method: .version_select at 0x7f9f39ab6b80>, body: {"keypair": {"name": "tempest-keypair-134749664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdXgI6CJ1nFwnJpw0FeWXhFcGFFQxV2i5sdGqC9X7DXsPqd6t53oQdv1esr4UvxMs+ZPpndwCdZMb8o4KCkIKC8ZRlJLAnJjplDJ9KLq6700uMlT77qva8cyUly56nI2w=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:44.046983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-0725641e-b784-4098-8b11-c2cb6126cad0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:44.051071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-0725641e-b784-4098-8b11-c2cb6126cad0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for user 1cccf354894c4311b7710d8a65682eeb and project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:44.077770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0725641e-b784-4098-8b11-c2cb6126cad0 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051110 Sep 19 14:54:44.078966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 196/306] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:54:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:44.084490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:44.089920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:44.095219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.095895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.096365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.097074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.097508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.097932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.244149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.254628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.256184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.257367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6695c6ec-d7c0-4c5e-803f-b91a1f05b9ad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1745 microversion: 2.20 time: 0.177427 Sep 19 14:54:44.258580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 197/307] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:44 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:44.396504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:44.397077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:44.400159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:44.405520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.406023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.406477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.408613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:44.408613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:44.408959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:44.568893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:44.577433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-07d7d9a2-f378-4a85-82a8-44d06386df36 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.184769 Sep 19 14:54:44.578651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 198/308] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:44 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:45.034032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:45.034961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:45.041779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.042266 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.042693 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.043403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.043851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.044279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.258912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:45.263663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:45.270958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9881583a-9999-4636-9d14-c3a7e29c3fbb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.240858 Sep 19 14:54:45.287383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 199/309] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:45 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:45.295334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:45.296483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:45.303713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.304283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.304792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.305501 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:45.306138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:45.306827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:45.492805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:45.501009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:45.502407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:45.503572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3d37bbbb-5a8e-4fde-b327-bbf185f45454 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.214650 Sep 19 14:54:45.504147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 200/310] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:45 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:45.510326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1800407423", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55ef7907-f8b2-4450-8200-3b3560538feb"}], "security_groups": [{"name": "tempest-securitygroup--2052160102"}], "key_name": "tempest-keypair-134749664", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:45.628483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] validate_networks() for [('55ef7907-f8b2-4450-8200-3b3560538feb', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:54:46.065594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:54:46.066225 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:54:46.066712 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:54:46.067891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:54:46.068643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:54:46.097261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.097954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.098584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.099934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.100942 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.102133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.125250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:54:46.129963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Getting quotas for user 1cccf354894c4311b7710d8a65682eeb and project 73c223bd20fc43eca4c1cd0921f7906d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:54:46.142899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:54:46.145565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:54:46.198226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ef01f558-77cc-4ee3-80d3-0b5bb133e3ba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.693039 Sep 19 14:54:46.199431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 201/311] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:54:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:54:46.216869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:46.217904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:46.232084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.234102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.235279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.238151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.243281 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.245283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.435110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:46.445805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1d85464f-d06d-45e9-8604-d0048aff5287 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.244156 Sep 19 14:54:46.447094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 202/312] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:46 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:46.451700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-962388dc-1f33-489b-aaea-c0f6cd0d408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:46.452463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-962388dc-1f33-489b-aaea-c0f6cd0d408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:46.527393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-962388dc-1f33-489b-aaea-c0f6cd0d408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:46.539314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-962388dc-1f33-489b-aaea-c0f6cd0d408a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1245 microversion: 2.1 time: 0.089929 Sep 19 14:54:46.540127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 203/313] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:46 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:46.546566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:46.555531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:46.562832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.563450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.564042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.565537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.566158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.566797 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.797912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:46.811975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a61a31f1-30e2-4113-bae5-dd1f0a46ffb4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.270286 Sep 19 14:54:46.812749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 204/314] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:46 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:46.822948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:46.822948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:46.829785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.829785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.829785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:46.829785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:46.830709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:46.830709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.100895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:47.115629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:47.120070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:47.121420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e9f5001e-613f-4aea-a777-671c3af6d4fb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.307667 Sep 19 14:54:47.122612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 205/315] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:46 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:47.129402 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-6df3baf7-cd17-4ec8-8d90-898f167edf6a req-9884500c-b695-4a6f-baff-413ee9c46ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4", "name": "network-vif-plugged", "status": "completed", "tag": "64ae02b1-c8f7-4ba2-b4ab-a4881fb44844"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:47.140564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6df3baf7-cd17-4ec8-8d90-898f167edf6a req-9884500c-b695-4a6f-baff-413ee9c46ed8 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.141307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6df3baf7-cd17-4ec8-8d90-898f167edf6a req-9884500c-b695-4a6f-baff-413ee9c46ed8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.141908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6df3baf7-cd17-4ec8-8d90-898f167edf6a req-9884500c-b695-4a6f-baff-413ee9c46ed8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.156731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-6df3baf7-cd17-4ec8-8d90-898f167edf6a req-9884500c-b695-4a6f-baff-413ee9c46ed8 service nova] Creating event network-vif-plugged:64ae02b1-c8f7-4ba2-b4ab-a4881fb44844 for instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 on hv-cinder-75670 Sep 19 14:54:47.162220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-6df3baf7-cd17-4ec8-8d90-898f167edf6a req-9884500c-b695-4a6f-baff-413ee9c46ed8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037935 Sep 19 14:54:47.163128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 206/316] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:47.473185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:47.474306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:47.481867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.482744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.483545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.484689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.485376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.486067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.638002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:47.650902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-237f8f3a-c759-445a-92d4-be08e3d7ef72 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.182900 Sep 19 14:54:47.651866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 207/317] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:47 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:47.656892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:47.657496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:47.664493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.664986 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.665424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.667162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.667162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.667438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.743205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:47.751445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e088532e-2bda-419b-a0ef-56c6cd9dc0e1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1297 microversion: 2.1 time: 0.098357 Sep 19 14:54:47.756181 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 208/318] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:47 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:47.842255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:47.842961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:47.849338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.849917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.850428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:47.851815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:47.852516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:47.853007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.024880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:48.034652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-61f50204-3c07-4c40-bbae-3b59090adacd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.196721 Sep 19 14:54:48.048564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 209/319] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:47 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:48.153393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:48.154465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:48.173790 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.174799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.176638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.187454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.195102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.200363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.371328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:48.380455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:48.381913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:48.384128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-99ace8fc-bad4-4789-ae16-67b2c3c2d52d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.238162 Sep 19 14:54:48.384686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 210/320] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:48 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:48.681832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:48.682708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:48.690189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.690855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.702984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.706046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.706690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.707019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.962659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:48.971584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-542ce872-3945-4fd3-80bd-81ac132cc988 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.296212 Sep 19 14:54:48.972742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 211/321] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:48 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:48.978466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:48.979307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:48.993591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.994255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.994800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:48.995770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:48.996664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:48.997198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:49.066256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:49.075017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-08ed8df2-1f32-42a8-a281-1bdc64fedb3f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1303 microversion: 2.1 time: 0.101068 Sep 19 14:54:49.092991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 212/322] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:48 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:49.099785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:49.100700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:49.107440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:49.108248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:49.108892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:49.109814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:49.110482 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:49.111249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:49.278497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:49.287447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5024baab-8d6f-4269-a262-27ece743c94c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1368 microversion: 2.1 time: 0.192333 Sep 19 14:54:49.300136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 213/323] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:49 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:49.300136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-f52acaaa-d57e-405c-903e-f1b1f8b4cf15 req-41b4a71b-0199-4839-b0be-03c00af40a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bbf69f-e276-453b-aee8-f8d8234c7da0", "name": "network-vif-plugged", "status": "completed", "tag": "9cdde95d-df11-450d-b00f-3a77132d88c0"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:49.305583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f52acaaa-d57e-405c-903e-f1b1f8b4cf15 req-41b4a71b-0199-4839-b0be-03c00af40a88 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:49.306154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f52acaaa-d57e-405c-903e-f1b1f8b4cf15 req-41b4a71b-0199-4839-b0be-03c00af40a88 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:49.307155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f52acaaa-d57e-405c-903e-f1b1f8b4cf15 req-41b4a71b-0199-4839-b0be-03c00af40a88 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:49.328125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-f52acaaa-d57e-405c-903e-f1b1f8b4cf15 req-41b4a71b-0199-4839-b0be-03c00af40a88 service nova] Creating event network-vif-plugged:9cdde95d-df11-450d-b00f-3a77132d88c0 for instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 on hv-cinder-75670 Sep 19 14:54:49.336374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-f52acaaa-d57e-405c-903e-f1b1f8b4cf15 req-41b4a71b-0199-4839-b0be-03c00af40a88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046518 Sep 19 14:54:49.338095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 214/324] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:49.414496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:49.415491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:49.423114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:49.423933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:49.424363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:49.425062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:49.425516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:49.425940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:49.586325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:49.597301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:49.598874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:49.600106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a6c226bb-99d6-490c-bb32-a4e4f7272de5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.190283 Sep 19 14:54:49.601575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 215/325] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:49 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:49.995087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:49.995815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:50.003555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.004074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.004504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.005206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.005658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.006081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.209489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.228103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-72a9e909-7601-40ef-a24c-0b2b1372bf5c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.237056 Sep 19 14:54:50.229429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 216/326] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:49 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:50.235545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:50.236865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:50.247978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.248362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.248805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.249662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.250181 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.250615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.331675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.345123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-92e65be2-b813-45b3-8953-7b4355da2aba tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1303 microversion: 2.1 time: 0.113529 Sep 19 14:54:50.346745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 217/327] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:50 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:50.358768 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:50.360176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:50.369331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.370198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.371369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.372634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.373367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.374029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.655949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.669255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e55766f5-e0a5-4de7-93a5-8f80e365be55 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1557 microversion: 2.1 time: 0.320935 Sep 19 14:54:50.679856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 218/328] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:50 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1557 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:50.679856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:50.679856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:50.687950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.687950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.687950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.687950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.688353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.688353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.710904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:50.846413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.858850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.860731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:50.863006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-02fd443e-9eb1-4a2b-bcd8-35f20f623fb7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.191809 Sep 19 14:54:50.864801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 219/329] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:50 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:50.871185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:50.871883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:50.891440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.892455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.893535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:50.894269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:50.895335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:50.895939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.030165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ba5b3d45-6f4b-4be3-a292-2bf99c45b575 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163565 Sep 19 14:54:51.030847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 220/330] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:54:50 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:51.252521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:51.253503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:51.261475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.262408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.263103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.264111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.264845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.265503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.512558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:51.519630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c5c67a1d-bf0f-4d2e-8cf3-1d0e81f94487 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1318 microversion: 2.1 time: 0.271075 Sep 19 14:54:51.535921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 221/331] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:51 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:51.535921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:51.535921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:51.535921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.536665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.536665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.536665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.537105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.537272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.860877 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:51.868673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cdb8a20c-9ce3-413e-a6e5-d32eac3d569d tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.344172 Sep 19 14:54:51.872008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 222/332] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:51 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:51.892892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:51.893481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:51.900276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.900773 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.901211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:51.901926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:51.902380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:51.902804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.357252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:52.372536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:52.374010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:52.375191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c41f3d26-c99d-4918-8990-82096be04646 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.486560 Sep 19 14:54:52.387858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 223/333] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:51 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:52.416342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-89acd5d6-8950-4436-aba3-b7ce3cc0e343 req-5c9b2a83-f417-4162-ba71-1a4beb16914b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8318af-931d-4569-8264-7a5d1ded7553", "tag": "09e588d6-8aef-4eee-8923-67987434a697"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:52.433237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-89acd5d6-8950-4436-aba3-b7ce3cc0e343 req-5c9b2a83-f417-4162-ba71-1a4beb16914b service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:52.434799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-89acd5d6-8950-4436-aba3-b7ce3cc0e343 req-5c9b2a83-f417-4162-ba71-1a4beb16914b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:52.435410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-89acd5d6-8950-4436-aba3-b7ce3cc0e343 req-5c9b2a83-f417-4162-ba71-1a4beb16914b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.451539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-89acd5d6-8950-4436-aba3-b7ce3cc0e343 req-5c9b2a83-f417-4162-ba71-1a4beb16914b service nova] Creating event network-changed:09e588d6-8aef-4eee-8923-67987434a697 for instance 8c8318af-931d-4569-8264-7a5d1ded7553 on hv-cinder-75670 Sep 19 14:54:52.460891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-89acd5d6-8950-4436-aba3-b7ce3cc0e343 req-5c9b2a83-f417-4162-ba71-1a4beb16914b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049729 Sep 19 14:54:52.462026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 224/334] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:52.551431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:52.552290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:52.562073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:52.562885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:52.563645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.564545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:52.565149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:52.565743 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.863983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:52.890551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cf440520-1197-4d63-ba69-dbc169919867 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1506 microversion: 2.1 time: 0.343223 Sep 19 14:54:52.891337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 225/335] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:52 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:52.907519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-2708176c-5091-492e-92fd-e6560400bf5e req-40e2cf8c-9d21-49e6-989a-d0e8e8b82e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4", "tag": "64ae02b1-c8f7-4ba2-b4ab-a4881fb44844"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:52.930471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2708176c-5091-492e-92fd-e6560400bf5e req-40e2cf8c-9d21-49e6-989a-d0e8e8b82e3e service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:52.931690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2708176c-5091-492e-92fd-e6560400bf5e req-40e2cf8c-9d21-49e6-989a-d0e8e8b82e3e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:52.932384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2708176c-5091-492e-92fd-e6560400bf5e req-40e2cf8c-9d21-49e6-989a-d0e8e8b82e3e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:52.983750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2708176c-5091-492e-92fd-e6560400bf5e req-40e2cf8c-9d21-49e6-989a-d0e8e8b82e3e service nova] Creating event network-changed:64ae02b1-c8f7-4ba2-b4ab-a4881fb44844 for instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 on hv-cinder-75670 Sep 19 14:54:53.000506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-2708176c-5091-492e-92fd-e6560400bf5e req-40e2cf8c-9d21-49e6-989a-d0e8e8b82e3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107364 Sep 19 14:54:53.005505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 226/336] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:54:53.010998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:53.014446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:53.033452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:53.034992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:53.035438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:53.036186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:53.036639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:53.037063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:53.378962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:53.386521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5753c15c-4169-40d6-8abf-fa48f0bfe2d6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.380079 Sep 19 14:54:53.400797 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 227/337] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:53 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:54:53.411457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:53.416328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:53.423089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:53.424391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:53.425046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:53.426027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:53.426755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:53.427874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:53.606209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:53.645107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:53.648622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:53.652579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-18b6bf85-20f2-46e6-8082-fa5036c6ac09 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.245317 Sep 19 14:54:53.653460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 228/338] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:53 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:54.413912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:54.414525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:54.422015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:54.422507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:54.422943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:54.423646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:54.424127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:54.424759 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:54.654027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:54.668610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-767368ad-4d43-444d-8266-2a4c1117bab8 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.258604 Sep 19 14:54:54.669763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 229/339] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:54 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:54.679669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:54.680701 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:54.689491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:54.690138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:54.690845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:54.692108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:54.692803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:54.693775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:54.984325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:55.005054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:55.012123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:55.013371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fc0ac99e-9b05-4586-b294-dee761a35ee6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.338394 Sep 19 14:54:55.014257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 230/340] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:54 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:55.698874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:55.699609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:55.707061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:55.708043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:55.708803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:55.709581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:55.710565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:55.711170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:55.928597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:55.958608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5ade4225-bca7-40c7-becd-7741a160b5bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.263673 Sep 19 14:54:55.959200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 231/341] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:55 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:56.050507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:56.051607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:56.059999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:56.061532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:56.064314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:56.065748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:56.066679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:56.068050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:56.123799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=6 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:56.248487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:56.264204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:56.265691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:56.266882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-854e0798-80ec-46be-88c1-763ee2616abf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.223237 Sep 19 14:54:56.291876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 232/342] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:56 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:56.997065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:56.997734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:56.999553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=32 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:57.006558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:57.008026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:57.008741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.009703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:57.014724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:57.015566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.177668 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:57.186941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a029df21-415a-4fab-bf29-30eed6d465f6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.194003 Sep 19 14:54:57.200164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 233/343] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:56 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:57.299391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:57.300291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:57.307267 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:57.307757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:57.308270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.309034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:57.309371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:57.309792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:57.447753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:57.455867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:57.457340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:57.458498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-816953ad-e9d1-479c-9029-c3e5a28bd70d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1740 microversion: 2.20 time: 0.163363 Sep 19 14:54:57.459051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 234/344] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:57 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:54:58.169574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-e504f855-1a19-4ca3-867f-02bb69da91b2 req-754aaf71-ebf2-4bdd-8cd0-b2badfbfa1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8318af-931d-4569-8264-7a5d1ded7553", "name": "network-vif-plugged", "status": "completed", "tag": "09e588d6-8aef-4eee-8923-67987434a697"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:54:58.181901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e504f855-1a19-4ca3-867f-02bb69da91b2 req-754aaf71-ebf2-4bdd-8cd0-b2badfbfa1b6 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.182644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e504f855-1a19-4ca3-867f-02bb69da91b2 req-754aaf71-ebf2-4bdd-8cd0-b2badfbfa1b6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.183243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e504f855-1a19-4ca3-867f-02bb69da91b2 req-754aaf71-ebf2-4bdd-8cd0-b2badfbfa1b6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.195651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-e504f855-1a19-4ca3-867f-02bb69da91b2 req-754aaf71-ebf2-4bdd-8cd0-b2badfbfa1b6 service nova] Creating event network-vif-plugged:09e588d6-8aef-4eee-8923-67987434a697 for instance 8c8318af-931d-4569-8264-7a5d1ded7553 on hv-cinder-75670 Sep 19 14:54:58.200519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-e504f855-1a19-4ca3-867f-02bb69da91b2 req-754aaf71-ebf2-4bdd-8cd0-b2badfbfa1b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Sep 19 14:54:58.201131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 235/345] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:54:58.212062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:58.212953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:58.222760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.223367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.223813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.224641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.225092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.225551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.462387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.470087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8a3224c7-5311-4be4-8f49-04eb5dba45d2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.263241 Sep 19 14:54:58.470648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 236/346] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:58 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:58.482830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:58.483412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:58.489046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.489539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.489946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.490619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:58.491062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:58.492106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:58.628812 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.636782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.638231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:58.639373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b03c411a-57ac-47df-bf8d-c96233870059 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1722 microversion: 2.20 time: 0.160146 Sep 19 14:54:58.639940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 237/347] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:58 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:54:59.492996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:59.493644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:59.500030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:59.500518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:59.500958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:59.501652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:59.502108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:59.502533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:59.525187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:59.638602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.646336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-670643ab-e882-4bdd-add2-06cdf94f68b9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.157352 Sep 19 14:54:59.646899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 238/348] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:54:59 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:54:59.664212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:54:59.664823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:54:59.666929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:54:59.674646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:59.675143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:59.675579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:59.676317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:54:59.676769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:54:59.677192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:54:59.817084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.826147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.827599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:54:59.828794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fc5abd85-af95-400f-82b0-fbd3bb91da5b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1722 microversion: 2.20 time: 0.168361 Sep 19 14:54:59.829349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 239/349] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:54:59 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:00.669343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:00.670020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:00.676279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.676757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.677180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.677861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.678332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.679335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.810202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:00.818035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b16811f9-4595-403e-9e49-fc7867cb589f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.152535 Sep 19 14:55:00.818612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 240/350] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:00 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:00.854491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:00.855113 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:00.861100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.861589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.862027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.862736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:00.863190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:00.863636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:00.998618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.006710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.008204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.009354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-942cbbef-e4a8-4319-a2a6-862e90a092a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1722 microversion: 2.20 time: 0.159364 Sep 19 14:55:01.009935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 241/351] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:00 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:01.841362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:01.842044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:01.848509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.848993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.849437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.850131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:01.850592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:01.851017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:01.984725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:01.992345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bd6811fd-c676-4276-9ba4-7976de74e9ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1371 microversion: 2.1 time: 0.155034 Sep 19 14:55:01.992916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 242/352] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:01 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:02.034618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:02.035230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:02.041916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.042401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.042841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.043542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.044035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.044460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.215269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:02.232851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:02.234405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:02.235579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d975d2cc-b04b-4c26-be63-a003bf823ed2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1725 microversion: 2.20 time: 0.204899 Sep 19 14:55:02.236170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 243/353] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:02 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:02.261499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ddab806-2e95-4948-86a1-12edee9e3300"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:02.263818 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:02.269761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.270249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.270687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.271382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.271846 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.272293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.581543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-96477143-a1af-4d5e-8cec-b3b8127102eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324351 Sep 19 14:55:02.587546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 244/354] 10.222.0.60 () {62 vars in 1364 bytes} [Mon Sep 19 14:55:02 2022] POST /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:55:02.591961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-7bc33090-632b-4494-b4dc-d1225043cbcc req-dd636abf-38b1-46a1-bb3a-b489e5476931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "name": "network-vif-unplugged", "status": "completed", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:02.603315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-7bc33090-632b-4494-b4dc-d1225043cbcc req-dd636abf-38b1-46a1-bb3a-b489e5476931 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.603725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-7bc33090-632b-4494-b4dc-d1225043cbcc req-dd636abf-38b1-46a1-bb3a-b489e5476931 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.604192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-7bc33090-632b-4494-b4dc-d1225043cbcc req-dd636abf-38b1-46a1-bb3a-b489e5476931 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.625910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-7bc33090-632b-4494-b4dc-d1225043cbcc req-dd636abf-38b1-46a1-bb3a-b489e5476931 service nova] Creating event network-vif-unplugged:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:55:02.631756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-7bc33090-632b-4494-b4dc-d1225043cbcc req-dd636abf-38b1-46a1-bb3a-b489e5476931 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048026 Sep 19 14:55:02.632606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 245/355] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:02.723213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:02.723927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:02.730808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.731290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.731736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.732455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.732913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.733370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.776595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126870) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 14:55:02.846206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-154d56a7-9071-4c0d-a285-8ac28c40f93e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/action" status: 202 len: 0 microversion: 2.20 time: 0.127021 Sep 19 14:55:02.847202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 246/356] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Sep 19 14:55:02 2022] POST /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:55:02.856635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:02.857275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:02.864170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.865364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.865364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:02.866155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:02.866605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:02.867081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.016793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.029539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.032473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.034234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a285366d-9e4e-4b5e-813e-b9276ed1a38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1751 microversion: 2.20 time: 0.183033 Sep 19 14:55:03.035045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 247/357] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:02 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:03.040551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:03.041243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:03.047563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.048231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.048735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.049525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.050051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.050544 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.186936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:03.195053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-49076cbd-4c8e-468f-8173-a90165f84d79 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1566 microversion: 2.1 time: 0.158166 Sep 19 14:55:03.196169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 248/358] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:03 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:03.219466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:03.220010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:03.226222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.227434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.227895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.228597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:03.229056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:03.229525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:03.321447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-03b48ed7-e633-4fd2-abd0-73534cbe2a70 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105609 Sep 19 14:55:03.322804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 249/359] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:55:03 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:55:04.066121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:04.067404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:04.075981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.076502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.076936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.077904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.078073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.078525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.236327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:04.245298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:04.246866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:04.248136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-86f1245b-1220-4d99-be3a-fdef3bc9d936 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1753 microversion: 2.20 time: 0.187191 Sep 19 14:55:04.248774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 250/360] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:04 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:04.365873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-e5346cd2-3c1c-4269-a2fb-ae0a6a7e4028 req-4ab20f47-3de2-4836-964d-142fc0045958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8318af-931d-4569-8264-7a5d1ded7553", "tag": "09e588d6-8aef-4eee-8923-67987434a697"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:04.378241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e5346cd2-3c1c-4269-a2fb-ae0a6a7e4028 req-4ab20f47-3de2-4836-964d-142fc0045958 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:04.378241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e5346cd2-3c1c-4269-a2fb-ae0a6a7e4028 req-4ab20f47-3de2-4836-964d-142fc0045958 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:04.378241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-e5346cd2-3c1c-4269-a2fb-ae0a6a7e4028 req-4ab20f47-3de2-4836-964d-142fc0045958 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:04.389337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-e5346cd2-3c1c-4269-a2fb-ae0a6a7e4028 req-4ab20f47-3de2-4836-964d-142fc0045958 service nova] Creating event network-changed:09e588d6-8aef-4eee-8923-67987434a697 for instance 8c8318af-931d-4569-8264-7a5d1ded7553 on hv-cinder-75670 Sep 19 14:55:04.394347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-e5346cd2-3c1c-4269-a2fb-ae0a6a7e4028 req-4ab20f47-3de2-4836-964d-142fc0045958 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032197 Sep 19 14:55:04.395117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 251/361] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:55:05.276815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:05.280757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:05.287554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:05.288203 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:05.288713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:05.289997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:05.290522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:05.290953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:05.431951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:05.441579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:05.443112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:05.444350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d3679246-393a-464a-9156-bb7a149e981e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.173743 Sep 19 14:55:05.444910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 252/362] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:05 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:06.469326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:06.470697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:06.478569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:06.479072 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:06.479529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:06.480345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:06.480725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:06.481150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:06.485752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:06.691090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:06.704642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:06.707585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:06.710082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-20d911d2-0b04-4c3b-8887-c35a1b0cf6bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.244703 Sep 19 14:55:06.721187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 253/363] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:06 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:07.449511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:07.450108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:07.457249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.457748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.458220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.458953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.459414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.459865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.487470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5fa28c5e-f9f6-408e-9762-2c9240d92163 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/ips" status: 200 len: 146 microversion: 2.1 time: 0.043097 Sep 19 14:55:07.490569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 254/364] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:55:07 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:55:07.744421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:07.745034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:07.751527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.752095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.752586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.753283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:07.753757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:07.754320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:07.892064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.901059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.902646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:07.903912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bfc4013a-c1d4-4f94-98ec-6a0da941ebac tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.163491 Sep 19 14:55:07.904477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 255/365] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:07 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:08.933211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:08.934840 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:08.944468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:08.945551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:08.945999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:08.946719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:08.947180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:08.947613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:09.107176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.117481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.118927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:09.121965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-15994546-b23a-4ef8-83f1-960741c2631e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.191374 Sep 19 14:55:09.123351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 256/366] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:08 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:10.148604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:10.149308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:10.155597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:10.156120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:10.156560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:10.157243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:10.157695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:10.158118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:10.302101 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:10.311317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:10.312950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:10.313972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3f55223b-5c3d-4409-bf75-569fc316355f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.169356 Sep 19 14:55:10.314743 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 257/367] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:10 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:11.342013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:11.343994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:11.352087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.352664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.353468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.354345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.355086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.356078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.515946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:11.525966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:11.527500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:11.528951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-24ae79f1-f355-45ee-aa2c-a904470fb150 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.192026 Sep 19 14:55:11.543789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 258/368] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:11 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:11.947083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4174e3d9-8144-48ee-9b76-a635afb4ed97", "device": "/dev/sdb"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:11.950053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:11.956218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.956706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.957138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:11.957845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:11.958294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:11.958720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.368723 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b67d35a0-3b50-40da-8116-59e98507ee1f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "POST /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.425550 Sep 19 14:55:18.369463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 259/369] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:55:11 2022] POST /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0/os-volume_attachments => generated 194 bytes in 6427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:55:18.374580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:18.375252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:18.381564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.381926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.382411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.383097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.383542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.383993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.513724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:18.522595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:18.524615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:18.525770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ae99b6cc-ef23-480b-b0c3-61b366505f07 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.155368 Sep 19 14:55:18.526323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 260/370] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:18 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:18.530978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "471ce30e-9100-494b-92b2-0ed85818398f"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:18.533383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:18.539899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.540386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.540821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:18.541512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:18.541960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:18.542376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:19.080179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c39b0e84-9785-4ecc-a36e-f30776c8d943 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552368 Sep 19 14:55:19.080880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 261/371] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:55:18 2022] POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:19.086717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-08cfdc44-1f4d-425e-84c6-bea74bd824c0 tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] Calling method '.version_select at 0x7f9f3995bd30>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:19.108146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-08cfdc44-1f4d-425e-84c6-bea74bd824c0 tempest-TestShelveInstance-664885124 tempest-TestShelveInstance-664885124-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2004629993" status: 202 len: 0 microversion: 2.1 time: 0.026010 Sep 19 14:55:19.108725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 262/372] 10.222.0.60 () {58 vars in 1254 bytes} [Mon Sep 19 14:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2004629993 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:55:19.552431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:19.553307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:19.561018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:19.561505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:19.561944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:19.562642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:19.563099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:19.563523 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:19.870568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:19.880062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:19.881567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:19.883058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-217b5913-7723-4b0b-b0ef-db2b293e2c74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.335280 Sep 19 14:55:19.883797 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 263/373] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:19 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:20.909146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:20.909768 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:20.925670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:20.926377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:20.927014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:20.928108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:20.928874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:20.929817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:21.152468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.161852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.163432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:21.164789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d61764bf-15f6-4c67-a8ba-5e3513883649 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.259950 Sep 19 14:55:21.165821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 264/374] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:20 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:22.190678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:22.191365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:22.197859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:22.198352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:22.198794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:22.199499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:22.199989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:22.200419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:22.386503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:22.398536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:22.403502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:22.404297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-15c53fd6-4947-4e3b-8d03-3acd13097d81 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.217650 Sep 19 14:55:22.404864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 265/375] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:22 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:23.429689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:23.430316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:23.437011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:23.437499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:23.437937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:23.438663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:23.439091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:23.439515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:23.666047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:23.674565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:23.676040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:23.677189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f01332d1-4462-4602-82f7-813cf42fd1ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.251708 Sep 19 14:55:23.677744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 266/376] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:23 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:24.704022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:24.705315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:24.712617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:24.713391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:24.713997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:24.714853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:24.715451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:24.716065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:24.944260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:24.957795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:24.959393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:24.962224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-02ac52c1-1254-4425-a169-a9c931aab59a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.261370 Sep 19 14:55:24.963528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 267/377] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:24 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:25.989083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:25.990633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:25.998949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:25.999863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:26.000853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:26.002328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:26.003326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:26.004219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:26.026678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:26.456519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:26.479172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:26.481106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:26.482306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-06c62fc2-23f2-4c71-b34d-ce3bfb5cd172 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.497459 Sep 19 14:55:26.483698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 268/378] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:25 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:27.510829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:27.511405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:27.517395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:27.517880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:27.518317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:27.519060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:27.519741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:27.520190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:27.663411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:27.672123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:27.673585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:27.674746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4cfbbe72-3c5f-4b80-a78c-3c92d1f3a56e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.169812 Sep 19 14:55:27.675303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 269/379] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:27 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:28.701165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:28.701889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:28.709011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:28.709608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:28.710144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:28.710971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:28.711559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:28.712116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:29.029852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:29.041248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:29.042828 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:29.044064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7a532cb3-ddbc-4edb-9bcd-b77322daf623 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.346879 Sep 19 14:55:29.044630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 270/380] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:28 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:30.071967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:30.072641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:30.075120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:30.080995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:30.081522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:30.081960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:30.082680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:30.083334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:30.083951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:30.259404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:30.276143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:30.277858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:30.279355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1ac86dcb-2d53-4ea8-af0f-975e188aacdb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.212059 Sep 19 14:55:30.280257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 271/381] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:30 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:31.310673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:31.311306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:31.317798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:31.318288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:31.318724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:31.320073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:31.320545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:31.321465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:31.640391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:31.657425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:31.659936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:31.662336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-abc4fdf2-2b1b-4da4-8d2b-a59151657e1f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.355793 Sep 19 14:55:31.663583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 272/382] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:31 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:32.689932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:32.690601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:32.698356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:32.698847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:32.699283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:32.700035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:32.700498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:32.700923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:32.855625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:32.865212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:32.866674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:32.867914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-afd1f92f-4b41-42e9-8592-07ee2242c0d4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.182690 Sep 19 14:55:32.868678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 273/383] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:32 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:33.894889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:33.895919 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:33.904224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:33.905170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:33.906036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:33.907140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:33.908029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:33.908718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:34.146403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:34.158060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:34.160493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:34.162207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b687cc0a-8276-4ec3-a07c-6814faf3cd9f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.271264 Sep 19 14:55:34.162809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 274/384] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:33 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:35.196255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:35.196992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:35.210589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:35.212758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:35.213492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:35.215253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:35.222015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:35.222834 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:35.550332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:35.566168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:35.568094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:35.569524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-17a09b7b-eccf-402b-b6d9-0d0545a032ef tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.379260 Sep 19 14:55:35.585443 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 275/385] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:35 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:35.612721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-a3e1f063-c8fa-4a47-9e30-f9172e1a3ef3 req-f32ac939-f3d3-4112-be57-8f9553b3e1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "name": "network-vif-plugged", "status": "completed", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:35.625887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a3e1f063-c8fa-4a47-9e30-f9172e1a3ef3 req-f32ac939-f3d3-4112-be57-8f9553b3e1e7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:35.626889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a3e1f063-c8fa-4a47-9e30-f9172e1a3ef3 req-f32ac939-f3d3-4112-be57-8f9553b3e1e7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:35.627546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a3e1f063-c8fa-4a47-9e30-f9172e1a3ef3 req-f32ac939-f3d3-4112-be57-8f9553b3e1e7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:35.650086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-a3e1f063-c8fa-4a47-9e30-f9172e1a3ef3 req-f32ac939-f3d3-4112-be57-8f9553b3e1e7 service nova] Creating event network-vif-plugged:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:55:35.659798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-a3e1f063-c8fa-4a47-9e30-f9172e1a3ef3 req-f32ac939-f3d3-4112-be57-8f9553b3e1e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052183 Sep 19 14:55:35.661236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 276/386] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:36.602836 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:36.603810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:36.619856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:36.620392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:36.620830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:36.621545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:36.622025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:36.622451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:36.776047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:36.788718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:36.791231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:36.792508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6d8a6faa-b360-4e60-a796-dde3365c01eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.197508 Sep 19 14:55:36.793075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 277/387] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:36 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:37.609494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3a6a1e6c-cc4f-4b2d-ba5a-54388a5b1a42 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:37.618098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3a6a1e6c-cc4f-4b2d-ba5a-54388a5b1a42 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.618686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3a6a1e6c-cc4f-4b2d-ba5a-54388a5b1a42 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.619190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3a6a1e6c-cc4f-4b2d-ba5a-54388a5b1a42 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.685983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3a6a1e6c-cc4f-4b2d-ba5a-54388a5b1a42 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Going to try to stop instance {{(pid=126870) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:55:37.744173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3a6a1e6c-cc4f-4b2d-ba5a-54388a5b1a42 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action" status: 202 len: 0 microversion: 2.1 time: 0.139224 Sep 19 14:55:37.745208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 278/388] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:55:37 2022] POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:55:37.754146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:37.754849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:37.761974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.762192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.762502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.763222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.763671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.764115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.918982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:37.928471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cd3e7d1b-a66f-4612-baa9-a62401f13e73 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.178625 Sep 19 14:55:37.929592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 279/389] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:37 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:37.950676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:37.951644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:37.958411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.959063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.960254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:37.961066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:37.961593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:37.962083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:38.134892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:38.144804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:38.146588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:38.148123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-91c5021b-5a09-4754-8966-4ffecbdaa33b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.201555 Sep 19 14:55:38.149430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 280/390] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:37 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:38.777903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6717de94-acec-4dcb-8703-acdf1254c57f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Action: 'create', calling method: .version_select at 0x7f9f3994d550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-579270075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaK3pCz4EHvznSgbYrLKF1RaULhtZ2rPBZvirnQjy8zIRE574Sj6+xeUKkWZ/pCUisNfAO6VIPX+SCkSLEIgk6mqFpwzpDr5nhuHYybd4wZAJ0qCAsODIF8tqj0Uf4qMw=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:38.798563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-6717de94-acec-4dcb-8703-acdf1254c57f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:55:38.802632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-6717de94-acec-4dcb-8703-acdf1254c57f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for user 52173f24f42a481380b047abe76bca57 and project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:55:38.826682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6717de94-acec-4dcb-8703-acdf1254c57f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.236504 Sep 19 14:55:38.827292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 281/391] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:55:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:55:38.958714 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:38.959347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:38.969280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:38.970053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:38.970631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:38.971484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:38.972107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:38.972679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:39.176703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.190436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a0019d7c-4bf6-447a-a7ec-81cfdd7318e8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.235570 Sep 19 14:55:39.191495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 282/392] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:38 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:39.198246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:39.198861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:39.208250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:39.213195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:39.213682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:39.214468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:39.214963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:39.215384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:39.459665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.469998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.471649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:39.472863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-033e9636-0a12-4965-bc29-bc0f112620a8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.279942 Sep 19 14:55:39.473620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 283/393] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:39 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:55:40.216708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:40.217341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:40.225193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.225939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.226537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.227985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.228624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.229219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.422471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:40.438577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d589ad17-2c2c-43db-be4e-21389c7f797c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.227488 Sep 19 14:55:40.439215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 284/394] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:40 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:40.500205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:40.500874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:40.507150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.507633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.508137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.508858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:40.509308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:40.509729 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:40.660042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:40.663602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:40.671889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:40.673208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:40.674396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f1a17424-5fe4-4fce-a3a1-b867b7c4aa04 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.178779 Sep 19 14:55:40.674946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 285/395] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:40 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:41.466990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:41.467618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:41.477699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:41.478424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:41.478872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:41.479586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:41.480246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:41.480666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:41.641131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:41.649609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8f97cff7-5e95-4c05-8203-1d09aaf20e04 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.190969 Sep 19 14:55:41.650296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 286/396] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:41 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:41.700995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:41.701734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:41.709949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:41.710772 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:41.711397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:41.712193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:41.712839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:41.713273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:41.858740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:41.868246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:41.869708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:41.870911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-40d4db1b-8644-4cdc-943f-27cc786118eb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1809 microversion: 2.20 time: 0.174074 Sep 19 14:55:41.871466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 287/397] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:41 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:42.673537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:42.674150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:42.681835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:42.682338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:42.682780 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:42.683490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:42.683991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:42.684383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:42.832824 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:42.842386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-24d50d55-bef1-41cf-949a-340ba9c2c33e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.172643 Sep 19 14:55:42.856214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 288/398] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:42 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:42.901171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:42.902075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:42.908695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:42.909199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:42.910057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:42.910673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:42.911137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:42.911562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.086403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.095540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.097022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:43.098184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2bbb6195-fbef-4c9d-a818-8909631fed3d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1796 microversion: 2.20 time: 0.201786 Sep 19 14:55:43.098741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 289/399] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:55:42 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1796 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:55:43.724090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:43.724766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:43.730974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.731462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.731923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.732627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:43.733081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:43.733507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:43.866138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lazy-loading 'services' on Instance uuid c3bbf69f-e276-453b-aee8-f8d8234c7da0 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:55:43.996348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dbe0cd02-13e4-4f26-ac1c-8d56a9592739 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0/os-volume_attachments/4174e3d9-8144-48ee-9b76-a635afb4ed97" status: 202 len: 0 microversion: 2.1 time: 0.276118 Sep 19 14:55:43.996941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 290/400] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:55:43 2022] DELETE /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0/os-volume_attachments/4174e3d9-8144-48ee-9b76-a635afb4ed97 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:55:44.002102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:44.002796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:44.009470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:44.009962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:44.010397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:44.011099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:44.011910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:44.012054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:44.176740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:44.185417 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d53d236d-79c3-4a99-88b6-76ccf1d05365 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.187278 Sep 19 14:55:44.185932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 291/401] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:43 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:45.135069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:45.135726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:45.144969 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.145466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.145905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.146615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.147070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.147698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.178145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:55:45.255257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c95bd03c-75cb-4b54-9a0b-cc86e05b4e21 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 204 len: 0 microversion: 2.1 time: 0.124366 Sep 19 14:55:45.256168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 292/402] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:55:45 2022] DELETE /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:55:45.262807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:45.263618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:45.271223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.271869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.272447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.273170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.273907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.274450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.406603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:45.415352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4b8e8839-6d2e-4c35-b5e0-9bca7de27396 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.158061 Sep 19 14:55:45.415937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 293/403] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:45 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:45.420667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:45.421271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:45.427331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.427902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.428383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.430972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:45.431529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:45.432329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:45.567294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:45.574981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7f127f39-cf6b-468b-b7b7-1719d247d03d tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1512 microversion: 2.1 time: 0.158101 Sep 19 14:55:45.575543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 294/404] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:45 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:46.438885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:46.439584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:46.446852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.447567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.448192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.449010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.449515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.450190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.581681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:46.592338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3ab4bb30-fadc-447f-828d-9d479d6f0eb0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.156312 Sep 19 14:55:46.593357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 295/405] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:46 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:46.598151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:46.598747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:46.604850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.605338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.605771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.606461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:46.606922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:46.607332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:46.743090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:46.750716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1c0b4bee-c4a1-4810-a7bd-96695e66d822 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1512 microversion: 2.1 time: 0.156268 Sep 19 14:55:46.751280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 296/406] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:46 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:47.616085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:47.616791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:47.624108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.624608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.625045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.625755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.626212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.626637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.821133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:47.829695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3dc48951-ba95-4675-bb74-45074825fef5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.217777 Sep 19 14:55:47.830370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 297/407] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:47 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:47.835275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-0b4c9f6e-b121-433c-8e9a-303eb1dea402 req-82e99e52-cd82-4623-8f4e-77f155fd9478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bbf69f-e276-453b-aee8-f8d8234c7da0", "name": "network-vif-deleted", "tag": "9cdde95d-df11-450d-b00f-3a77132d88c0"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:47.845621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-0b4c9f6e-b121-433c-8e9a-303eb1dea402 req-82e99e52-cd82-4623-8f4e-77f155fd9478 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.846108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-0b4c9f6e-b121-433c-8e9a-303eb1dea402 req-82e99e52-cd82-4623-8f4e-77f155fd9478 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.846546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-0b4c9f6e-b121-433c-8e9a-303eb1dea402 req-82e99e52-cd82-4623-8f4e-77f155fd9478 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.861742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-0b4c9f6e-b121-433c-8e9a-303eb1dea402 req-82e99e52-cd82-4623-8f4e-77f155fd9478 service nova] Creating event network-vif-deleted:9cdde95d-df11-450d-b00f-3a77132d88c0 for instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 on hv-cinder-75670 Sep 19 14:55:47.867758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-0b4c9f6e-b121-433c-8e9a-303eb1dea402 req-82e99e52-cd82-4623-8f4e-77f155fd9478 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035327 Sep 19 14:55:47.868389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 298/408] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:55:47.873672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:47.874783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:47.884221 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.885407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.885852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.888915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.888915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.888915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.922749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:47.923353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:47.923782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:47.924249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lazy-loading 'fault' on Instance uuid c3bbf69f-e276-453b-aee8-f8d8234c7da0 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:55:47.968620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:47.976825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d69c3c72-27d6-4103-a11f-11977afc7c5f tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 200 len: 1308 microversion: 2.1 time: 0.106633 Sep 19 14:55:47.977470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 299/409] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:47 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:48.853803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:48.854473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:48.856895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:48.862267 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:48.862755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:48.863193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:48.863918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:48.864376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:48.864806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:48.884092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:49.008384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:49.016810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4f252a23-2164-4a92-ad0e-ec662514e765 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.167540 Sep 19 14:55:49.017375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 300/410] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:48 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:49.021799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:49.022400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: c3bbf69f-e276-453b-aee8-f8d8234c7da0] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:49.028502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:49.028987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:49.029430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:49.030119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:49.030576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:49.031003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:49.045597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] HTTP exception thrown: Instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 could not be found. Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Request method failure captured: Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 HTTP/1.1 Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKrvdwLjf_egShbpkGxKBvoD8h3XfLDxVwMGc3dRinl7cod3aiz6DPfkIdNVgTpd0YV-gmuQ1G7HYakA6h7Pk6SmzG-IGzvCB0HD78IvGKk8YWPz4Pr_OQqZO57S3MhC6x6rcdFNKTy7HjK9V9XIBqHkGEDE3YrXnNjQFAEPKllof0 Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: aeec00f3a752480cb9ac3a670bcb297d Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1394909078 Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:55:49.047550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aeec00f3a752480cb9ac3a670bcb297d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aeec00f3a752480cb9ac3a670bcb297d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aeec00f3a752480cb9ac3a670bcb297d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aeec00f3a752480cb9ac3a670bcb297d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1394909078 Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: aeec00f3a752480cb9ac3a670bcb297d Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1394909078 Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesSnapshotTestJSON-1394909078-project Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: c0b677827f1648319b0616aec4db66e6 Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1394909078-project Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 could not be found. Sep 19 14:55:49.049185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'c3bbf69f-e276-453b-aee8-f8d8234c7da0'} Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 could not be found. Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:55:49.050118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 could not be found. Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 could not be found. Sep 19 14:55:49.051412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:55:49.052575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Returning 404 to user: Instance c3bbf69f-e276-453b-aee8-f8d8234c7da0 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:55:49.052575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6d5db995-aee2-4df9-97bb-95f1029f3f8c tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0" status: 404 len: 111 microversion: 2.1 time: 0.031136 Sep 19 14:55:49.052575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 301/411] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:49 2022] GET /compute/v2.1/servers/c3bbf69f-e276-453b-aee8-f8d8234c7da0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:55:50.040725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:50.041360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:50.047724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.048239 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.048673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.049358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:50.049811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:50.050233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:50.179695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:50.188610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2e7f19d7-e2d0-4a84-aa81-4dfcced96ec3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.151901 Sep 19 14:55:50.189163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 302/412] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:50 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:51.214404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:51.215043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:51.221642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:51.222128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:51.222565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:51.223257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:51.223713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:51.224164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:51.363104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:51.372119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dcff86d5-29a6-42a5-a2ca-b5c1eb9c9de5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.163078 Sep 19 14:55:51.372692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 303/413] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:51 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:52.395503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:52.396114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:52.403239 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.403787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.404280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.404964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:52.405412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:52.405827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:52.539665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:52.547945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-30954cd0-c6ee-405d-be83-3316df2a9f80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.156315 Sep 19 14:55:52.548599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 304/414] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:52 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:53.571497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:53.572359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:53.578789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:53.579303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:53.579841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:53.580557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:53.581009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:53.581501 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:53.717514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:53.725735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-966fbf48-2d6e-4507-a2db-ce5f9cd87fa5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.158384 Sep 19 14:55:53.726395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 305/415] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:53 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:54.751519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:54.752200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:54.758154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.758633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.759070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.759755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:54.760232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:54.760658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:54.892992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:54.901775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-544b6805-5510-4020-b4ee-a4a736e35231 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.154228 Sep 19 14:55:54.902333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 306/416] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:54 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:55.927179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:55.927880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:55.935503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.936031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.936469 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:55.937157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:55.937606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:55.938027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:56.072060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:56.081407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6bae5e11-256c-4efc-8f8e-fb07976f76c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.158955 Sep 19 14:55:56.081978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 307/417] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:55 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:57.105180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:57.105795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:57.112504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:57.112992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:57.113428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:57.114125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:57.114580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:57.115006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:57.243278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:57.252032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3e6a36ca-ea80-4346-b921-9dc346d1ea4c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.151071 Sep 19 14:55:57.252602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 308/418] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:57 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:58.275121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:58.275785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:58.282090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:58.282566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:58.283041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:58.283722 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:58.284195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:58.284615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:58.415442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:58.423655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4d47f57a-87db-4dc3-9b3b-302c19ebafae tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.152582 Sep 19 14:55:58.424259 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 309/419] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:58 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:55:58.971326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-117537304", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "networks": [{"uuid": "0bda37ba-05ad-4638-bdea-6a00d9ba8c3e"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:55:59.028071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] validate_networks() for [('0bda37ba-05ad-4638-bdea-6a00d9ba8c3e', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:55:59.379958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:55:59.380574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:55:59.381184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:55:59.381592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:55:59.382001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:55:59.390791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:59.391260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:59.391688 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:59.392434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:59.392879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:59.393296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:59.404774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:55:59.411751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Getting quotas for project aeec00f3a752480cb9ac3a670bcb297d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:55:59.417156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Getting quotas for user c0b677827f1648319b0616aec4db66e6 and project aeec00f3a752480cb9ac3a670bcb297d. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:55:59.428292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:55:59.431093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:55:59.479644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bf84e226-023d-4687-839a-afaad2e41715 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512321 Sep 19 14:55:59.480344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 310/420] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:55:59.484893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:59.485500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:59.493059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:59.493555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:59.494010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:59.494701 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:55:59.495164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:55:59.495595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:55:59.633750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:59.642420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-003f23ba-c76b-4d58-ad43-b49e5b0ac9f2 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.161074 Sep 19 14:55:59.642989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 311/421] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:59 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:55:59.647563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-49a2a45f-bd4d-4499-9584-fd79715c25fa tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:55:59.648194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-49a2a45f-bd4d-4499-9584-fd79715c25fa tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:55:59.704398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-49a2a45f-bd4d-4499-9584-fd79715c25fa tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:55:59.712565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-49a2a45f-bd4d-4499-9584-fd79715c25fa tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1218 microversion: 2.1 time: 0.068531 Sep 19 14:55:59.713600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 312/422] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:55:59 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:00.033424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1172339936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-579270075", "security_groups": [{"name": "tempest-secgroup-smoke-591621420"}], "block_device_mapping_v2": [{"uuid": "699659ab-8cd3-4983-b642-4f9c02a9f564", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fec6bb0-9f94-43d5-b3e5-a726dd57258c"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:00.162574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] validate_networks() for [('2fec6bb0-9f94-43d5-b3e5-a726dd57258c', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:56:00.539256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:56:00.539885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:56:00.540182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:56:00.540594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:56:00.541017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:56:00.549392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:00.549872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:00.550306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:00.551026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:00.551480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:00.551944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:00.568744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:00.572995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for user 52173f24f42a481380b047abe76bca57 and project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:00.629638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:56:00.631794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='699659ab-8cd3-4983-b642-4f9c02a9f564',volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:56:00.762237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-28cdac51-621c-457a-bb0d-23b859825140 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732950 Sep 19 14:56:00.763478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 313/423] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:56:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:56:00.768140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:00.768931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:00.778257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:00.788219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:00.789470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:00.790199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:00.790667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:00.791086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.020490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:01.029707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0ad8b014-d40d-48b7-ab89-9b6923138263 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.265020 Sep 19 14:56:01.030457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 314/424] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:00 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:01.035052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.035660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.042331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.042796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.043230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.043958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.044581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.045159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.133706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:01.141895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f8ea5293-2050-43ee-b43d-969547ef6f22 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1276 microversion: 2.1 time: 0.110423 Sep 19 14:56:01.142609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 315/425] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:01 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:01.147662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c9f1991a-149e-4741-bcf3-5a53de088556 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.148945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c9f1991a-149e-4741-bcf3-5a53de088556 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.215426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c9f1991a-149e-4741-bcf3-5a53de088556 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:01.223104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c9f1991a-149e-4741-bcf3-5a53de088556 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1094 microversion: 2.1 time: 0.078975 Sep 19 14:56:01.223679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 316/426] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:01 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:01.243742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.244278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.250428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.250915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.251356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.252088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.252551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.252974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.278506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ba86c429-2a5b-4286-87d7-2cf5a62d29c5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/ips" status: 200 len: 148 microversion: 2.1 time: 0.041349 Sep 19 14:56:01.279147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 317/427] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:56:01 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/ips => generated 148 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:01.292219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9a9d87c-76e6-4a98-bd72-5eb48e807b1c"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:01.295270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.302466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.303133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.303647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.304506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.305281 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.305774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.393695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Invalid volume: volume e9a9d87c-76e6-4a98-bd72-5eb48e807b1c is already attached to instances: df1f4045-79b2-43d2-b1c4-e0a77d7d338b Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: POST /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/os-volume_attachments HTTP/1.1 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 74 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:56:01.395311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {"volumeAttachment": {"volumeId": "e9a9d87c-76e6-4a98-bd72-5eb48e807b1c"}} Sep 19 14:56:01.396767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Invalid volume: volume e9a9d87c-76e6-4a98-bd72-5eb48e807b1c is already attached to instances: df1f4045-79b2-43d2-b1c4-e0a77d7d338b Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'server_id': '8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4', 'body': {'volumeAttachment': {'volumeId': 'e9a9d87c-76e6-4a98-bd72-5eb48e807b1c'}}} Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e9a9d87c-76e6-4a98-bd72-5eb48e807b1c is already attached to instances: df1f4045-79b2-43d2-b1c4-e0a77d7d338b Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:01.397577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e9a9d87c-76e6-4a98-bd72-5eb48e807b1c is already attached to instances: df1f4045-79b2-43d2-b1c4-e0a77d7d338b Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:01.400130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e9a9d87c-76e6-4a98-bd72-5eb48e807b1c is already attached to instances: df1f4045-79b2-43d2-b1c4-e0a77d7d338b Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 400 to user: Invalid volume: volume e9a9d87c-76e6-4a98-bd72-5eb48e807b1c is already attached to instances: df1f4045-79b2-43d2-b1c4-e0a77d7d338b {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1e95624e-3922-4eb5-9ca2-4067f8390543 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108842 Sep 19 14:56:01.401717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 318/428] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:56:01 2022] POST /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:56:01.406279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.409456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.414345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.414829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.415259 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.415978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.416442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.416848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.444231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:01.500316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:01.530080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-08c59029-f381-46d8-9d84-2ca009504bfd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 204 len: 0 microversion: 2.1 time: 0.127188 Sep 19 14:56:01.534215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 319/429] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:01 2022] DELETE /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:56:01.540509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:01.541212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:01.547813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.548361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.548823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.549550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:01.550026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:01.550572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:01.782112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:01.789857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bd645a75-7656-4c1e-a1dc-965cc9669c6a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1681 microversion: 2.1 time: 0.254419 Sep 19 14:56:01.790419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 320/430] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:01 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:02.053876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:02.055005 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:02.064779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.065266 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.065702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.066396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.066848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.067270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.200266 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.208389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9f3e8ec4-6207-4759-8c08-bfc854822e51 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.158494 Sep 19 14:56:02.208957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 321/431] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:02 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:02.213387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:02.213980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:02.219632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.220175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.220607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.221293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.221771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.222192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.349681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.360494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fda75457-c375-4794-9e54-1133df5d90c6 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.150204 Sep 19 14:56:02.361465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 322/432] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:02 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:02.366280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:02.366885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:02.372725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.373213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.373650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.374343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.374794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.375218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.440824 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.448445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9a2284b9-415e-4d8c-9fff-225e7c9d1818 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1192 microversion: 2.1 time: 0.085809 Sep 19 14:56:02.449020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 323/433] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:02 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:02.813730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:02.814408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:02.820852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.821328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.821757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.822439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:02.822885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:02.823303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:02.951436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:02.959187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-abe27782-e59d-42eb-bf11-a8d1cc457f7f tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1681 microversion: 2.1 time: 0.149328 Sep 19 14:56:02.959751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 324/434] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:02 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:03.231886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:03.232512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:03.238670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.240244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.240244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.240522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.240923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.241902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.515039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:03.524961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5d1e36df-5e68-4051-8f5a-a3ccb464c44e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.297382 Sep 19 14:56:03.525537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 325/435] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:03 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:03.530146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:03.530757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:03.536712 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.537407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.537850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.539055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.539515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.540054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.754367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:03.762536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6b824d05-b0a6-4529-9ee8-e29b9ec552ff tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.236012 Sep 19 14:56:03.763112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 326/436] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:03 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:03.767528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:03.768361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:03.775348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.775865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.776368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.777070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.777526 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.777946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.852499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:03.860410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-55d3a3cf-f91f-4a66-9383-17681782cc2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1192 microversion: 2.1 time: 0.096299 Sep 19 14:56:03.860993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 327/437] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:03 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:03.983039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:03.983653 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:03.989598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.990171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.990524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:03.991223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:03.991681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:03.992133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:04.365567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:04.377382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f6b48e2f-18e1-4d5c-bf04-889b524bdd25 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1681 microversion: 2.1 time: 0.398119 Sep 19 14:56:04.377967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 328/438] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:03 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1681 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:04.398441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-728832b5-c971-44ce-846b-8d44784ebb33 req-6d1fded9-8de6-4ad5-b160-f098775a8cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef328ddb-042d-42c5-97cd-1497db04bd48", "tag": "07dfda96-d929-409d-af60-17ff55783a50"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:04.408461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-728832b5-c971-44ce-846b-8d44784ebb33 req-6d1fded9-8de6-4ad5-b160-f098775a8cd4 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:04.408863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-728832b5-c971-44ce-846b-8d44784ebb33 req-6d1fded9-8de6-4ad5-b160-f098775a8cd4 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:04.409296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-728832b5-c971-44ce-846b-8d44784ebb33 req-6d1fded9-8de6-4ad5-b160-f098775a8cd4 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:04.425210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-728832b5-c971-44ce-846b-8d44784ebb33 req-6d1fded9-8de6-4ad5-b160-f098775a8cd4 service nova] Creating event network-changed:07dfda96-d929-409d-af60-17ff55783a50 for instance ef328ddb-042d-42c5-97cd-1497db04bd48 on hv-cinder-75670 Sep 19 14:56:04.431049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-728832b5-c971-44ce-846b-8d44784ebb33 req-6d1fded9-8de6-4ad5-b160-f098775a8cd4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037649 Sep 19 14:56:04.432168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 329/439] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:04.557450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:04.558632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:04.565871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:04.566733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:04.567294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:04.568317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:04.569256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:04.569748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.045385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.057577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-42acf2ab-9192-4b5e-b1a1-614e383c9983 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.505800 Sep 19 14:56:05.059102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 330/440] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:04 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:05.065730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:05.066542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:05.076563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.077484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.078902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.080099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.081155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.081884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.328410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.337143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-78a2908a-ca90-4a67-b47b-604b63ef3163 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.276043 Sep 19 14:56:05.353427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 331/441] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:05 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:05.358512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:05.359133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:05.365360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.365847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.366290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.367522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.368038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.368639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.456664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.466870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3306705d-a963-4c79-8fe1-b41b6c39a6ff tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1198 microversion: 2.1 time: 0.112236 Sep 19 14:56:05.480460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 332/442] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:05 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:05.488432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-6f97abec-9e1d-44c6-9151-5e02377d829c req-375964b2-6df4-4c8f-a74a-820765403ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4", "name": "network-vif-deleted", "tag": "64ae02b1-c8f7-4ba2-b4ab-a4881fb44844"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:05.498721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6f97abec-9e1d-44c6-9151-5e02377d829c req-375964b2-6df4-4c8f-a74a-820765403ec8 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.499200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6f97abec-9e1d-44c6-9151-5e02377d829c req-375964b2-6df4-4c8f-a74a-820765403ec8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.499633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6f97abec-9e1d-44c6-9151-5e02377d829c req-375964b2-6df4-4c8f-a74a-820765403ec8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.512128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-6f97abec-9e1d-44c6-9151-5e02377d829c req-375964b2-6df4-4c8f-a74a-820765403ec8 service nova] Creating event network-vif-deleted:64ae02b1-c8f7-4ba2-b4ab-a4881fb44844 for instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 on hv-cinder-75670 Sep 19 14:56:05.517365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-6f97abec-9e1d-44c6-9151-5e02377d829c req-375964b2-6df4-4c8f-a74a-820765403ec8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Sep 19 14:56:05.518175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 333/443] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:05.527623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:05.528565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:05.535902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.536604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.537230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.538104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:05.539261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:05.539875 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:05.638399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:05.656152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ec2be654-426d-458d-9dee-cd8af0aa0bf1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 200 len: 1327 microversion: 2.1 time: 0.128104 Sep 19 14:56:05.668522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 334/444] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:05 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:06.083974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:06.085503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:06.094360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.095053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.095690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.096419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.096869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.097288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.338761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:06.356994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-92e339fc-8bc8-4514-a0c1-5fa011e03ebd tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.276941 Sep 19 14:56:06.372905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 335/445] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:06 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:06.379315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:06.380088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:06.387331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.387817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.388272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.388990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.389439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.389861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.716355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:06.724634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bc06f0f2-e03d-41a2-acd1-6149f015fbef tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.350477 Sep 19 14:56:06.725213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 336/446] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:06 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:06.730964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:06.731769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:06.738172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.738863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.739481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:06.740360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:06.742414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:06.742854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.011138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:07.019293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:07.021943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-70705c7c-41f7-4862-8735-49c99c2aff47 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.295072 Sep 19 14:56:07.026177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 337/447] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:06 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:07.046504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:07.047380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:07.054089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.054795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.055430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.057222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.057842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.058425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.077251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 HTTP/1.1 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:56:07.079160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:56:07.080638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4'} Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:07.081400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:56:07.082863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:07.084698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:07.084698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-60e0b8c3-c8a9-44eb-90b3-05babb8fd527 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 404 len: 111 microversion: 2.1 time: 0.038185 Sep 19 14:56:07.084698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 338/448] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:07 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:56:07.093348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9d9a85c0-3582-4b1c-a26d-3a34f91a21e0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '.version_select at 0x7f9f3a7283a0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:07.114862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9d9a85c0-3582-4b1c-a26d-3a34f91a21e0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103837273" status: 202 len: 0 microversion: 2.1 time: 0.025491 Sep 19 14:56:07.115464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 339/449] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Sep 19 14:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103837273 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:07.382450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:07.383405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:07.392992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.394294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.394959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.396451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.397159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.398089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.652012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:07.675771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e31749e2-e55c-4eb4-a8dd-fa511444e5af tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.297111 Sep 19 14:56:07.677370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 340/450] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:07 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:07.683709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-cb1bd567-d01e-4d9d-bbb9-f83abd90d7be req-a128df56-baab-4f6f-8ae0-f4f1ba864ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e15404-48df-4490-8dc2-f0f5308f06f7", "tag": "238639e7-7652-49a7-a143-93ed41e99dad"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:07.696459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:07.698515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb1bd567-d01e-4d9d-bbb9-f83abd90d7be req-a128df56-baab-4f6f-8ae0-f4f1ba864ff4 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.699031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb1bd567-d01e-4d9d-bbb9-f83abd90d7be req-a128df56-baab-4f6f-8ae0-f4f1ba864ff4 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.699693 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb1bd567-d01e-4d9d-bbb9-f83abd90d7be req-a128df56-baab-4f6f-8ae0-f4f1ba864ff4 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.716230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-cb1bd567-d01e-4d9d-bbb9-f83abd90d7be req-a128df56-baab-4f6f-8ae0-f4f1ba864ff4 service nova] Creating event network-changed:238639e7-7652-49a7-a143-93ed41e99dad for instance 15e15404-48df-4490-8dc2-f0f5308f06f7 on hv-cinder-75670 Sep 19 14:56:07.725179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-cb1bd567-d01e-4d9d-bbb9-f83abd90d7be req-a128df56-baab-4f6f-8ae0-f4f1ba864ff4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044536 Sep 19 14:56:07.726842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 341/451] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:07.750189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:07.751240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:07.762127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.763163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.763902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:07.764793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:07.765436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:07.766036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.026318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:08.034321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-89225df7-72dc-4d89-8fe0-56457f929955 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.289376 Sep 19 14:56:08.035802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 342/452] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:07 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:08.052834 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:08.053397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:08.060932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.061094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.061528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.062286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.062938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.063280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.153672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lazy-loading 'services' on Instance uuid df1f4045-79b2-43d2-b1c4-e0a77d7d338b {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:08.231713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d10a191d-7658-4ee0-8ca7-10aa08c838fb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments/e9a9d87c-76e6-4a98-bd72-5eb48e807b1c" status: 202 len: 0 microversion: 2.1 time: 0.182567 Sep 19 14:56:08.232358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 343/453] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:56:08 2022] DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments/e9a9d87c-76e6-4a98-bd72-5eb48e807b1c => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:08.238573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:08.239275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:08.246415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.246907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.247347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.248084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.248536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.248961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.393261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:08.415932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-feb7739f-52de-4ef3-8c5e-93f92300bf02 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.169041 Sep 19 14:56:08.415932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 344/454] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:08 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:08.415932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:08.415932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:08.417790 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.418345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.419100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.420120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.420736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.421159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.453089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2e605a9f-60be-4736-9f34-dc0008bef03e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048474 Sep 19 14:56:08.454012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 345/455] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:56:08 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:08.704762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:08.705292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:08.711705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.712297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.712884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.713720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:08.714364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:08.714884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:08.916452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:08.925061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c5eb202e-ac06-40ad-b200-da515aacb016 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1723 microversion: 2.1 time: 0.224199 Sep 19 14:56:08.925931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 346/456] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:08 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:09.059129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:09.059786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:09.066395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.066887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.067367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.068183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.068639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.069065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.391210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:09.400201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6ae08c31-4e81-472a-a6bf-b820e5365c91 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.345251 Sep 19 14:56:09.411856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 347/457] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:09 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:09.426650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:09.427261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:09.433623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.434110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.434551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.435246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.435703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.436436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.597660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:09.605767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-569d9d5f-baba-43e0-9b40-dd38678853d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.182914 Sep 19 14:56:09.606374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 348/458] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:09 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:09.612851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:09.615493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:09.623470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.624006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.624441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.626077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.626696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.627126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.660158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-142f399e-2802-4b32-ae08-d268d57005c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052573 Sep 19 14:56:09.660720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 349/459] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:56:09 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:56:09.671405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-29aa0807-ad4d-498f-ba16-76e3ca95a7b9 req-5375f2d2-3f46-4b33-bd2c-7f4a3b22675d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef328ddb-042d-42c5-97cd-1497db04bd48", "name": "network-vif-plugged", "status": "completed", "tag": "07dfda96-d929-409d-af60-17ff55783a50"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:09.682908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-29aa0807-ad4d-498f-ba16-76e3ca95a7b9 req-5375f2d2-3f46-4b33-bd2c-7f4a3b22675d service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.683385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-29aa0807-ad4d-498f-ba16-76e3ca95a7b9 req-5375f2d2-3f46-4b33-bd2c-7f4a3b22675d service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.683809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-29aa0807-ad4d-498f-ba16-76e3ca95a7b9 req-5375f2d2-3f46-4b33-bd2c-7f4a3b22675d service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.695992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-29aa0807-ad4d-498f-ba16-76e3ca95a7b9 req-5375f2d2-3f46-4b33-bd2c-7f4a3b22675d service nova] Creating event network-vif-plugged:07dfda96-d929-409d-af60-17ff55783a50 for instance ef328ddb-042d-42c5-97cd-1497db04bd48 on hv-cinder-75670 Sep 19 14:56:09.702502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-29aa0807-ad4d-498f-ba16-76e3ca95a7b9 req-5375f2d2-3f46-4b33-bd2c-7f4a3b22675d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035003 Sep 19 14:56:09.703103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 350/460] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:09.730872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:09.731464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:09.737624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.738107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.738553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.739249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.739704 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.740180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.767781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:09.849127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e476f1e2-7e2e-489f-a84a-1fbf42ca8a1c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 204 len: 0 microversion: 2.1 time: 0.122101 Sep 19 14:56:09.850166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 351/461] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:09 2022] DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:56:09.858788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:09.859631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:09.866885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.867491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.867977 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:09.868715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:09.869169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:09.869707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.001301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:10.009932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-320bcd3d-714c-4afa-b55c-f996c0ea9880 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1681 microversion: 2.1 time: 0.155315 Sep 19 14:56:10.010198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 352/462] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:09 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:10.015075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:10.015675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:10.021438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.021914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.022345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.023028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.023478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.023941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.157375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:10.166276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7cf1dc62-d732-42e1-b506-c2e20178dee3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1700 microversion: 2.1 time: 0.155046 Sep 19 14:56:10.166869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 353/463] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:10 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:10.189063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2af3509e-d7fd-486b-bbcd-d536983aaaf7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:10.194904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2af3509e-d7fd-486b-bbcd-d536983aaaf7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.195368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2af3509e-d7fd-486b-bbcd-d536983aaaf7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.195802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2af3509e-d7fd-486b-bbcd-d536983aaaf7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.216961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2af3509e-d7fd-486b-bbcd-d536983aaaf7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Going to try to start instance {{(pid=126870) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 14:56:10.233798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:10.258656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2af3509e-d7fd-486b-bbcd-d536983aaaf7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action" status: 202 len: 0 microversion: 2.1 time: 0.073108 Sep 19 14:56:10.259258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 354/464] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:10 2022] POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:56:10.267406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:10.268136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:10.274087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.274568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.275004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.275691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.276185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.276628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.405376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:10.413560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2abdc3b1-2e99-4b52-a8b0-6cd6db7d5774 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1709 microversion: 2.1 time: 0.150068 Sep 19 14:56:10.414125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 355/465] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:10 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:10.423499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:10.424131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:10.429859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.430337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.430773 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.431454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.432380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.432809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.560367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:10.563488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:10.571992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c47329fd-2eaf-4b7f-8672-40c070cdd495 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.151941 Sep 19 14:56:10.572473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 356/466] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:10 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:10.628966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:10.629479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:10.635975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.636464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.636904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.637595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:10.638056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:10.638485 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:10.770752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:10.778429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c0c94ad9-14af-474c-b57a-b59ddcd1d82f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.153247 Sep 19 14:56:10.778991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 357/467] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:10 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:11.033058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:11.033661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:11.040194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.040679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.041131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.041808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.042261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.042691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.172154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.181312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6919ca27-8ec4-4fc2-af2f-c72c24af1a7c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1681 microversion: 2.1 time: 0.152090 Sep 19 14:56:11.182269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 358/468] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:11 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:11.437254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:11.437895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:11.439594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=16 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:11.446168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.446656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.447096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.447788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.448277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.448702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.575803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.585028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f472afde-dc87-4da0-a93c-33070e82a939 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1709 microversion: 2.1 time: 0.151726 Sep 19 14:56:11.585604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 359/469] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:11 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:11.594091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:11.594698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:11.600935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.601420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.601861 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.602553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.603013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.603432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.793434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.801510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f6ca051c-101d-4e23-a898-658b63d21bc3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1318 microversion: 2.1 time: 0.211029 Sep 19 14:56:11.802121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 360/470] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:11 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:11.807468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:11.808098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:11.814451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.814592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.814995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.815695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:11.816183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:11.816610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:11.950336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:11.958069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ba585704-bf1f-48be-aa78-d440e27c0fc5 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.155001 Sep 19 14:56:11.958619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 361/471] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:11 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:12.205224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:12.205898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:12.212494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.212978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.213411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.214106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.214623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.215039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.498909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:12.506779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f1c33a99-b9a7-4547-97e6-d73567519014 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1681 microversion: 2.1 time: 0.305529 Sep 19 14:56:12.507353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 362/472] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:12 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:12.580546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ab36061-df50-4b48-a9bf-13335ddb94e6"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:12.583028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:12.589328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.589836 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.590263 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:12.590950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:12.591399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:12.591846 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.099366 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-83a6a7f1-c13a-431b-9c38-554a154e25ae tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522622 Sep 19 14:56:13.100019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 363/473] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:56:12 2022] POST /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:13.105737 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:13.106510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:13.114468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.114966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.115405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.116669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.118424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.118424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.588453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:13.596632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fd51a583-b5f0-440b-9baa-d00f19b514a8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1709 microversion: 2.1 time: 0.495310 Sep 19 14:56:13.597200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 364/474] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:13 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1709 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:13.602210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:13.602854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:13.608882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.609465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.609895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.610600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.611086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.611502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.803311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:13.813248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f8620f4c-a8d6-46bb-9f2b-bf17ba60c26e tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1507 microversion: 2.1 time: 0.214846 Sep 19 14:56:13.823883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 365/475] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:13 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:13.823883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:13.823883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:13.825622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.826117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.826550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.827250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:13.827700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:13.828151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:13.982457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:13.990273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b8428092-5d52-4b37-b58e-5b89aad2b134 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.175444 Sep 19 14:56:14.004048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 366/476] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:13 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:14.004048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:14.004048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:14.004048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.004678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.004678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.004678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.004911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.005188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.068706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:14.076814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-45ef8c30-6cda-4871-b5a1-7eed5cbd5ef0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1613 microversion: 2.1 time: 0.084323 Sep 19 14:56:14.078264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 367/477] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:13 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:14.090494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-c7929130-dd26-4555-b7c1-b5cf67518f2b req-134821e5-c68e-4a05-9908-7ac449bb0863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1f4045-79b2-43d2-b1c4-e0a77d7d338b", "name": "network-vif-deleted", "tag": "88d66ec9-13e4-4177-84dc-a8ef92c4eebb"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:14.100084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-c7929130-dd26-4555-b7c1-b5cf67518f2b req-134821e5-c68e-4a05-9908-7ac449bb0863 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.101090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-c7929130-dd26-4555-b7c1-b5cf67518f2b req-134821e5-c68e-4a05-9908-7ac449bb0863 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.101527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-c7929130-dd26-4555-b7c1-b5cf67518f2b req-134821e5-c68e-4a05-9908-7ac449bb0863 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.112444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-c7929130-dd26-4555-b7c1-b5cf67518f2b req-134821e5-c68e-4a05-9908-7ac449bb0863 service nova] Creating event network-vif-deleted:88d66ec9-13e4-4177-84dc-a8ef92c4eebb for instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b on hv-cinder-75670 Sep 19 14:56:14.121883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-c7929130-dd26-4555-b7c1-b5cf67518f2b req-134821e5-c68e-4a05-9908-7ac449bb0863 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043338 Sep 19 14:56:14.122484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 368/478] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:14.127641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88b981da-cb76-4f3f-8934-db38ae611b5c", "device": "/dev/sdb"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:14.130198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:14.136922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.137407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.137845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.138538 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.138995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.139437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.588698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:14.729725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9dc976d9-9371-4eca-9ed4-82ea57b74de3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "POST /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605899 Sep 19 14:56:14.730331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 369/479] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:56:14 2022] POST /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:14.735385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:14.736132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:14.743599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.744711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.745163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.745908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:14.746359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:14.746782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:14.881832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:14.890236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8c7db3a7-e5c3-465e-a7cd-608f7b0402dc tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1709 microversion: 2.1 time: 0.158794 Sep 19 14:56:14.890814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 370/480] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:14 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:15.018575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:15.019173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:15.025963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.026487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.026930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.027655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.028156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.028585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.175040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:15.183402 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-08bffd0e-4a3f-4811-ae44-f49ef71b7288 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.168725 Sep 19 14:56:15.183990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 371/481] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:15 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:15.188389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:15.188984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:15.194791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.195279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.195717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.196487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.196955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.197384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.228882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.229363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.229799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.230249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lazy-loading 'fault' on Instance uuid df1f4045-79b2-43d2-b1c4-e0a77d7d338b {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:15.270303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:15.278441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-db99f486-2652-4099-9f54-352ce0bff4ce tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1330 microversion: 2.1 time: 0.093469 Sep 19 14:56:15.279014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 372/482] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:15 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:15.913934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:15.914623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:15.920906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.921750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.922215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:15.923194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:15.923711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:15.924141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.115903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.124663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7fa0adb7-0295-403e-a56b-2d66d3bf81b0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1713 microversion: 2.1 time: 0.215213 Sep 19 14:56:16.125246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 373/483] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:15 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1713 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:16.206359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:16.206971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:16.215623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.216073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.216735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.217472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.219249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.220449 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.363340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.371480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b99a3d86-3124-4b79-82fd-78f08bf008b2 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.168935 Sep 19 14:56:16.375859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 374/484] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:16 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:16.377051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:16.377660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:16.384053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.384558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.384981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.385670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.386156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.386614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.418217 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.418703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.419138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.419585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lazy-loading 'fault' on Instance uuid df1f4045-79b2-43d2-b1c4-e0a77d7d338b {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:16.460115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.467933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a9b2f445-a9c9-41e3-a893-082f46eae8ee tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 200 len: 1330 microversion: 2.1 time: 0.094466 Sep 19 14:56:16.468741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 375/485] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:16 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:16.473465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:16.476365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:16.482299 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.482875 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.483316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.484052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.484522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.484927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.508714 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'flavor' on Instance uuid 8c8318af-931d-4569-8264-7a5d1ded7553 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:16.649745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0aafaed0-aaca-4e64-91d0-7f6e87eda0a1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/action" status: 200 len: 32 microversion: 2.1 time: 0.179933 Sep 19 14:56:16.655247 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 376/486] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:16 2022] POST /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:56:16.662451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:16.664004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:16.671399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.672018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.672473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.673211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:16.673665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:16.674170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:16.889517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:16.898575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f4cb94dd-87ca-4800-9abf-90d33b380092 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.240497 Sep 19 14:56:16.899477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 377/487] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:16 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:17.394598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.395254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:17.402428 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.402915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.403352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.404077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.404539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.404963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.538697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:17.546441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d0f9ebda-8046-488f-ae64-2a4f5c673172 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.155690 Sep 19 14:56:17.546948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 378/488] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:17 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:17.551321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.551940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:17.558409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.558646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.559040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.559727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.560199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.560618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.574889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b HTTP/1.1 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:56:17.576567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:56:17.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'df1f4045-79b2-43d2-b1c4-e0a77d7d338b'} Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:17.579078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:56:17.580467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:17.581734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:17.581734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-befd9ce4-30e8-4134-a7bc-47f4359bb3c3 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 404 len: 111 microversion: 2.1 time: 0.030094 Sep 19 14:56:17.581734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 379/489] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:17 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:56:17.587369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a6b6332a-f4d0-4bf9-85db-cf11a31fefa9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '.version_select at 0x7f9f3d153af0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.607685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a6b6332a-f4d0-4bf9-85db-cf11a31fefa9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275884561" status: 202 len: 0 microversion: 2.1 time: 0.024213 Sep 19 14:56:17.608581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 380/490] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Sep 19 14:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275884561 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:17.614020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-8fb46127-3904-49f1-b38a-bfab572b0475 req-d45447ba-2914-473e-aa86-40fb68065f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e15404-48df-4490-8dc2-f0f5308f06f7", "name": "network-vif-plugged", "status": "completed", "tag": "238639e7-7652-49a7-a143-93ed41e99dad"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:17.629943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8fb46127-3904-49f1-b38a-bfab572b0475 req-d45447ba-2914-473e-aa86-40fb68065f6d service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.630721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8fb46127-3904-49f1-b38a-bfab572b0475 req-d45447ba-2914-473e-aa86-40fb68065f6d service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.632069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8fb46127-3904-49f1-b38a-bfab572b0475 req-d45447ba-2914-473e-aa86-40fb68065f6d service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.644901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-8fb46127-3904-49f1-b38a-bfab572b0475 req-d45447ba-2914-473e-aa86-40fb68065f6d service nova] Creating event network-vif-plugged:238639e7-7652-49a7-a143-93ed41e99dad for instance 15e15404-48df-4490-8dc2-f0f5308f06f7 on hv-cinder-75670 Sep 19 14:56:17.650525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-8fb46127-3904-49f1-b38a-bfab572b0475 req-d45447ba-2914-473e-aa86-40fb68065f6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Sep 19 14:56:17.651481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 381/491] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:17.923402 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:17.924214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:17.930718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.931274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.932059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:17.932820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:17.933404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:17.933847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:18.161973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:18.170304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f3eece53-cd73-4ec1-a70a-2257f906c5f4 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.251136 Sep 19 14:56:18.170914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 382/492] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:17 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:18.412213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-464ca9ab-d3a3-4ef2-8678-093d8b3b7982 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: .version_select at 0x7f9f397ed9d0>, body: {"keypair": {"name": "tempest-keypair-1309030038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLP9ncLSmkqSGRO6QlJ4dwU7AkpUwIvVo32pSihZJIkobPajpL0jCf2ieZ4nJ+M+AfAhZan459cwMzXovJuLLsMT5tQI+sOdf829LetOmNxDg1jldyCaJJKfmsHneGNGQ=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:18.429248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-464ca9ab-d3a3-4ef2-8678-093d8b3b7982 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:18.431361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:18.434211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-464ca9ab-d3a3-4ef2-8678-093d8b3b7982 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:18.457562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-464ca9ab-d3a3-4ef2-8678-093d8b3b7982 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049177 Sep 19 14:56:18.458148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 383/493] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:56:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:18.568814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:18.569958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:18.576033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:18.576530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:18.576974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:18.577681 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:18.578170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:18.578598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:18.728491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:18.740084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8ebeed40-259f-4f39-a878-05b917719c57 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1265 microversion: 2.1 time: 0.175200 Sep 19 14:56:18.741379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 384/494] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:18 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:19.195179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:19.195911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:19.202015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:19.202510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:19.202946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:19.203639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:19.204133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:19.204560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:19.336540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:19.345262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0853dad6-8dc0-487d-a939-367e447c6d02 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.154273 Sep 19 14:56:19.345951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 385/495] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:19 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:19.759521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-20791465", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be7d8aa6-9b4b-4d6b-91e8-89101b447c76"}], "security_groups": [{"name": "tempest-securitygroup--1975465574"}], "key_name": "tempest-keypair-1309030038", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:19.864725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] validate_networks() for [('be7d8aa6-9b4b-4d6b-91e8-89101b447c76', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:56:20.267972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:56:20.268403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:56:20.268879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:56:20.269292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:56:20.269710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:56:20.279056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.279745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.280222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.280953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.281414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.281835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.288680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:20.302756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:20.308290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:20.321111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:56:20.323649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:56:20.371388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9725ca33-3f66-4b6d-b675-61fa48a3b280 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616100 Sep 19 14:56:20.372059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 386/496] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:56:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:56:20.380844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:20.381612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:20.388344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.388749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.389179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.389873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.390319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.390734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.523594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.531962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5e6e70a3-6f98-4636-b4ee-6b6c54a68670 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1452 microversion: 2.1 time: 0.158760 Sep 19 14:56:20.532580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 387/497] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:20 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:20.537153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:20.537763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:20.543648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.544230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.544734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.545488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.546010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.546496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.682132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.691154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b1d3930e-36e9-4918-ac9d-786b45cf1801 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.157566 Sep 19 14:56:20.691789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 388/498] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:20 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:20.696401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a784245a-0004-40d7-95da-a7eeaf0e8b53 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:20.697010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a784245a-0004-40d7-95da-a7eeaf0e8b53 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:20.754598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a784245a-0004-40d7-95da-a7eeaf0e8b53 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.763102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a784245a-0004-40d7-95da-a7eeaf0e8b53 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1240 microversion: 2.1 time: 0.070178 Sep 19 14:56:20.763772 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 389/499] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:20 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:20.768233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:20.768836 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:20.777009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.777500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.778141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.778835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:20.779295 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:20.779726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:20.918433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:20.926607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f4010113-5e6f-4784-9b54-f749430c1f19 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1452 microversion: 2.1 time: 0.161994 Sep 19 14:56:20.927214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 390/500] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:20 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:21.715257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:21.721400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:21.722799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.723643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.724099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.724650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.725434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.725625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.864019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:21.874207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cfd630c6-d312-4157-abcd-00f1b5b1abc2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.163038 Sep 19 14:56:21.874781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 391/501] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:21 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:21.889507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:21.890299 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:21.896630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.897880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.898327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.899038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:21.899492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:21.900344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:21.966380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:21.974034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-024bd752-5415-4a33-9496-ab95005337a0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1300 microversion: 2.1 time: 0.091467 Sep 19 14:56:21.974637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 392/502] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:21 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:22.900041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:22.901888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:22.913337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:22.914398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:22.915028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:22.916089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:22.916904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:22.917491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:23.174970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:23.185562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7b08a017-9b7c-4b04-8810-f341500dd60a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.290727 Sep 19 14:56:23.186390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 393/503] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:22 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:23.191811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:23.192715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:23.201161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:23.201884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:23.202570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:23.203473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:23.204093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:23.204530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:23.281252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:23.293405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3f7bac20-6682-448b-8e76-a9ad4babaabf tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1298 microversion: 2.1 time: 0.105577 Sep 19 14:56:23.294610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 394/504] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:23 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:23.301465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-aeb782ee-1b0b-428a-8e6a-0e185e2cb837 req-ef7a6c8d-e07c-4d40-b911-cb91e76b77d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e15404-48df-4490-8dc2-f0f5308f06f7", "tag": "238639e7-7652-49a7-a143-93ed41e99dad"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:23.315576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-aeb782ee-1b0b-428a-8e6a-0e185e2cb837 req-ef7a6c8d-e07c-4d40-b911-cb91e76b77d0 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:23.316094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-aeb782ee-1b0b-428a-8e6a-0e185e2cb837 req-ef7a6c8d-e07c-4d40-b911-cb91e76b77d0 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:23.316531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-aeb782ee-1b0b-428a-8e6a-0e185e2cb837 req-ef7a6c8d-e07c-4d40-b911-cb91e76b77d0 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:23.338690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-aeb782ee-1b0b-428a-8e6a-0e185e2cb837 req-ef7a6c8d-e07c-4d40-b911-cb91e76b77d0 service nova] Creating event network-changed:238639e7-7652-49a7-a143-93ed41e99dad for instance 15e15404-48df-4490-8dc2-f0f5308f06f7 on hv-cinder-75670 Sep 19 14:56:23.346083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-aeb782ee-1b0b-428a-8e6a-0e185e2cb837 req-ef7a6c8d-e07c-4d40-b911-cb91e76b77d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050136 Sep 19 14:56:23.346751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 395/505] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:24.212520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:24.213206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:24.219593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.220122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.220565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.221279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.221752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.222269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.455202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:24.464316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b3bb80b3-d8ea-4ec8-925f-ce2dd6771fe2 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.257278 Sep 19 14:56:24.464889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 396/506] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:24 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:24.469357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:24.470025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:24.476099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.476583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.477010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.477699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.478173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.478631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.700559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:24.710139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fe3c7135-f9ec-4369-a83f-b2dcc749e3a6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.243577 Sep 19 14:56:24.710721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 397/507] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:24 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:24.722383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-d1dc326d-f89a-4636-8bf4-448b12d2a28b req-3c1efad3-3d35-4507-9f38-8a0c1ab4fd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf690c71-c2d4-432f-b912-4d9b0918f3af", "tag": "88eb59a5-7768-48b5-bf92-78da65a37cc5"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:24.731794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-d1dc326d-f89a-4636-8bf4-448b12d2a28b req-3c1efad3-3d35-4507-9f38-8a0c1ab4fd58 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:24.732301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-d1dc326d-f89a-4636-8bf4-448b12d2a28b req-3c1efad3-3d35-4507-9f38-8a0c1ab4fd58 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:24.732725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-d1dc326d-f89a-4636-8bf4-448b12d2a28b req-3c1efad3-3d35-4507-9f38-8a0c1ab4fd58 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:24.744116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-d1dc326d-f89a-4636-8bf4-448b12d2a28b req-3c1efad3-3d35-4507-9f38-8a0c1ab4fd58 service nova] Creating event network-changed:88eb59a5-7768-48b5-bf92-78da65a37cc5 for instance cf690c71-c2d4-432f-b912-4d9b0918f3af on hv-cinder-75670 Sep 19 14:56:24.748859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-d1dc326d-f89a-4636-8bf4-448b12d2a28b req-3c1efad3-3d35-4507-9f38-8a0c1ab4fd58 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030066 Sep 19 14:56:24.749451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 398/508] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:25.489643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:25.490302 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:25.497113 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:25.497603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:25.498045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:25.498751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:25.499211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:25.499634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:25.909592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:25.918004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a92c5bd4-8e4b-454e-95bd-58e8cbc565d9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.433190 Sep 19 14:56:25.918576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 399/509] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:25 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:25.923197 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:25.923884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:25.931278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:25.932171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:25.932791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:25.933739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:25.934195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:25.934792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.064185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:26.072835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b2fc5dfa-3159-4f65-8930-c0df0b5bf2c2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.153286 Sep 19 14:56:26.073410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 400/510] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:25 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:26.945175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:26.945806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:26.952445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:26.952936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:26.953378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:26.954146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:26.954547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:26.954975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:27.194034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:27.202147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f6ed3457-661c-4975-a02b-8b1a72bc2f87 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.260822 Sep 19 14:56:27.202718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 401/511] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:26 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:27.207182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:27.207788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:27.214747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:27.215236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:27.215671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:27.216467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:27.216923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:27.217776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:27.410498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:27.418599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-185c8b29-5aed-49e1-813d-5204c87841d7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.214944 Sep 19 14:56:27.419159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 402/512] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:27 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:28.226948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:28.227573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.234115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.234600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.235037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.235731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.236211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.236640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.368532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.376732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2571e23e-2658-445e-8e85-100a14fb07bc tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.153808 Sep 19 14:56:28.377298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 403/513] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:28 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:28.442488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:28.443318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:28.450166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.450653 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.451090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.451777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:28.452256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:28.452677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:28.583344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:28.590999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3fa7a3be-1e02-471b-8430-cac009a767e8 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.152381 Sep 19 14:56:28.591560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 404/514] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:28 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:29.401473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:29.402140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:29.408573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:29.409060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:29.409498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:29.410191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:29.410645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:29.411073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:29.544628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:29.548151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:29.554232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-047ef3f6-05f6-4c73-a4f8-52cdb9050a67 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.157238 Sep 19 14:56:29.554804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 405/515] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:29 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:29.613272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:29.613868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:29.620447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:29.620955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:29.621354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:29.622029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:29.622476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:29.622893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:29.750794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:29.758926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-31bdaa40-15d8-4d0d-87f7-9802173c1324 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.149405 Sep 19 14:56:29.759486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 406/516] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:29 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:30.579093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:30.579749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:30.581492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:30.587187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.587667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.588134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.588823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.589276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.589708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.718947 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.727742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-523854ed-49ad-4363-9cab-33cf3e1f1da1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.152569 Sep 19 14:56:30.728341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 407/517] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:30 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:30.781289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:30.781894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:30.783717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=12 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:30.789572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.790053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.790489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.791175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:30.791628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:30.792078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:30.921655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:30.930072 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2a9a2ac9-2bb3-4fcb-a842-95b58ea4a704 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.152522 Sep 19 14:56:30.930654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 408/518] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:30 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:31.751214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:31.752002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:31.758804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.759380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.759731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.760467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.760923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.761348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.889713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:31.898720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-66282287-928a-44f1-bf0a-d82898810a36 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.151453 Sep 19 14:56:31.899291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 409/519] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:31 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:31.954143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:31.954776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:31.961697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.962192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.962593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:31.963285 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:31.963737 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:31.964178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.098889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:32.106548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-18636c67-debf-496a-beaf-f5f49f95c33e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.156193 Sep 19 14:56:32.107116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 410/520] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:31 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:32.925474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:32.926537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:32.936183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.936573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.937008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:32.937710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:32.938191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:32.938610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.104487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.116034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5d4fd6ab-4f57-4c1e-b785-4950b0ee4d69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.196015 Sep 19 14:56:33.116624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 411/521] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:32 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:33.130614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:33.131514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:33.138985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.139617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.140106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.141219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:33.141821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:33.142351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:33.281963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:33.289477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7a49588b-2eb2-4668-bb47-42e540fee70a tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.162779 Sep 19 14:56:33.290051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 412/522] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:33 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:34.144375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:34.145088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:34.151852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.152349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.152788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.153501 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.153956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.154376 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.298474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:34.307713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8b8e0d89-a805-414c-9976-fddf0cf768b5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.167224 Sep 19 14:56:34.308322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 413/523] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:34 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:34.313432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:34.314047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:34.320166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.320654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.321090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.321792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:34.322247 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:34.322674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:34.457271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:34.465121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5d716d29-fe4a-42d0-b76a-07481b233d37 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.155811 Sep 19 14:56:34.465760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 414/524] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:34 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:35.330246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:35.330855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:35.337670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.338157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.341525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.341525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.341525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.341525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.470025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.478330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2aa6105c-570c-4cc5-971d-18df47c2df69 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1736 microversion: 2.1 time: 0.151888 Sep 19 14:56:35.478903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 415/525] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:35 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:35.484078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:35.484577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:35.491057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.491546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.492018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.492713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.493164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.493589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.577245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lazy-loading 'services' on Instance uuid ef328ddb-042d-42c5-97cd-1497db04bd48 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:35.648857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4d37076d-8836-4542-9ad3-c4c10b65ed8b tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48/os-volume_attachments/88b981da-cb76-4f3f-8934-db38ae611b5c" status: 202 len: 0 microversion: 2.1 time: 0.168712 Sep 19 14:56:35.649437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 416/526] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:56:35 2022] DELETE /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48/os-volume_attachments/88b981da-cb76-4f3f-8934-db38ae611b5c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:35.654431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:35.655138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:35.661559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.662044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.662971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.663671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.664145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.664572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.807320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:35.816870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cb356908-30b4-491f-9c3e-82f05f7793ef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.166038 Sep 19 14:56:35.817650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 417/527] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:35 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:35.924991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-687e6536-ed56-4e55-9375-d78e105be846 req-8b0b3d04-0f70-49d4-8f04-bc343a178ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf690c71-c2d4-432f-b912-4d9b0918f3af", "name": "network-vif-plugged", "status": "completed", "tag": "88eb59a5-7768-48b5-bf92-78da65a37cc5"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:35.934961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-687e6536-ed56-4e55-9375-d78e105be846 req-8b0b3d04-0f70-49d4-8f04-bc343a178ba7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:35.935436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-687e6536-ed56-4e55-9375-d78e105be846 req-8b0b3d04-0f70-49d4-8f04-bc343a178ba7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:35.935884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-687e6536-ed56-4e55-9375-d78e105be846 req-8b0b3d04-0f70-49d4-8f04-bc343a178ba7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:35.947353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-687e6536-ed56-4e55-9375-d78e105be846 req-8b0b3d04-0f70-49d4-8f04-bc343a178ba7 service nova] Creating event network-vif-plugged:88eb59a5-7768-48b5-bf92-78da65a37cc5 for instance cf690c71-c2d4-432f-b912-4d9b0918f3af on hv-cinder-75670 Sep 19 14:56:35.952405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-687e6536-ed56-4e55-9375-d78e105be846 req-8b0b3d04-0f70-49d4-8f04-bc343a178ba7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031004 Sep 19 14:56:35.953073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 418/528] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:36.503121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:36.503871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:36.510049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.510535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.510977 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.511670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.512163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.512589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.650876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:36.659253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5f248573-3346-4e33-9645-34f0f4e52dee tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1716 microversion: 2.1 time: 0.160803 Sep 19 14:56:36.659817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 419/529] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:36 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:36.773820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:36.774399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:36.780502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.780987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.781418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.782166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.782625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.783041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.870950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] HTTP exception thrown: Cannot 'detach_volume' instance 8c8318af-931d-4569-8264-7a5d1ded7553 while it is in vm_state rescued Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Request method failure captured: Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments/2ab36061-df50-4b48-a9bf-13335ddb94e6 HTTP/1.1 Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIupeH_kuHISBrwHOUes8TECc-yxkq7b0k3DfsWggDcApN4As7X5NzdGOoPirf2u3aPbJvApSy3DvooofC8KEV4NI5rcW5jEkWYQIM7pZDnZpnJf_mRnNsu3-t8RbAU_CzK_dNp42W3_VdekEppHEJ5_n4Rv8cZMzkSm_fGMP7mlmU Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:56:36.872611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73c223bd20fc43eca4c1cd0921f7906d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 1cccf354894c4311b7710d8a65682eeb Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:56:36.874194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Cannot 'detach_volume' instance 8c8318af-931d-4569-8264-7a5d1ded7553 while it is in vm_state rescued Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'server_id': '8c8318af-931d-4569-8264-7a5d1ded7553', 'id': '2ab36061-df50-4b48-a9bf-13335ddb94e6'} Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:36.875008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8c8318af-931d-4569-8264-7a5d1ded7553 while it is in vm_state rescued Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8c8318af-931d-4569-8264-7a5d1ded7553 while it is in vm_state rescued Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:36.876471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Returning 409 to user: Cannot 'detach_volume' instance 8c8318af-931d-4569-8264-7a5d1ded7553 while it is in vm_state rescued {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:36.877597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c88abaa4-1e0d-4acf-8cee-f7f1d90e8216 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments/2ab36061-df50-4b48-a9bf-13335ddb94e6" status: 409 len: 152 microversion: 2.1 time: 0.105021 Sep 19 14:56:36.878293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 420/530] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:56:36 2022] DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments/2ab36061-df50-4b48-a9bf-13335ddb94e6 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 19 14:56:36.885518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:36.886170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:36.888362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:36.894604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.895058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.895489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:36.896352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:36.897230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:36.897650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.049641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:37.057634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-45959c22-8af1-42dc-ae39-f2de64a6eeef tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.178324 Sep 19 14:56:37.058178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 421/531] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:36 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:37.062598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:37.063117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:37.068586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.069091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.069524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.070208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.070662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.071082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.088511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:37.138477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5b7d1ef4-8cdd-483c-a4c5-f12561f9aa13 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "POST /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/action" status: 202 len: 0 microversion: 2.1 time: 0.079106 Sep 19 14:56:37.141692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 422/532] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:56:37 2022] POST /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:56:37.148181 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:37.148871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:37.154835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.155307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.155738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.156445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:37.156889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:37.157305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:37.289342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:37.297691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c25dd369-22fe-46ee-a8ee-d18b8e2a41ef tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1724 microversion: 2.1 time: 0.154108 Sep 19 14:56:37.298249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 423/533] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:37 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:38.081302 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:38.081945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:38.089251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.089744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.090642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.090867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.091323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.091745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.253270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:38.260974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1deafc58-1e71-4bc3-a3fb-7c48819134ba tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.183917 Sep 19 14:56:38.261541 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 424/534] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:38 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:38.322794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:38.323626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:38.330835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.331562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.332274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.333316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.334548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.335236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.471750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:38.480586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9a3d6bfc-6eda-4558-a713-432763b38c35 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1724 microversion: 2.1 time: 0.162848 Sep 19 14:56:38.481175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 425/535] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:38 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:38.897578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:38.898125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:38.904129 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.904609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.905038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.905724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:38.906175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:38.906590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:38.933045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:39.028089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f5030cc5-f7d0-4201-9b7e-3663986b6256 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 204 len: 0 microversion: 2.1 time: 0.133589 Sep 19 14:56:39.029156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 426/536] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:56:38 2022] DELETE /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:56:39.038155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.039147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.047425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.047954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.048462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.049090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.049548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.049969 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.182728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.190576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0752bbe6-5a7a-4339-a12c-c72a595cd7a3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1513 microversion: 2.1 time: 0.156987 Sep 19 14:56:39.191128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 427/537] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:39.286300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.286902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.292978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.293459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.293895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.294580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.295037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.295457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.429186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.436997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f5546d72-c468-4e0d-9ef9-f44d5ed8da90 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.154454 Sep 19 14:56:39.437547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 428/538] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:39.507306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:39.507941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:39.513916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.514399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.514832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.515521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:39.516014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:39.516442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:39.646958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:39.655456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-72a1a812-7191-4a1a-bdbe-c44d21c3847a tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1724 microversion: 2.1 time: 0.152100 Sep 19 14:56:39.656045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 429/539] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:39 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:40.214297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.214961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.221276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.221755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.222186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.222874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.223319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.223738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.355309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.364750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e2dacf10-754f-41d7-bbfc-f9c21420e603 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1513 microversion: 2.1 time: 0.154402 Sep 19 14:56:40.365344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 430/540] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:40.459776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.460598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.466696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.467186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.467622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.468352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.468810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.469235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.600604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.608199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2ea98c5a-6d24-46fd-9422-8515d1e04265 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1366 microversion: 2.1 time: 0.153054 Sep 19 14:56:40.608695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 431/541] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:40.686581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:40.687184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:40.693140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.694237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.694676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.695372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:40.695854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:40.696299 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:40.829330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:40.837898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dc9a11c8-4bc5-4957-88fb-f9b7c9d21fbb tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1724 microversion: 2.1 time: 0.155004 Sep 19 14:56:40.838508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 432/542] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:40 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:41.387396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.388088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.394733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.395280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.395717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.396964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.397417 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.397842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.672276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.680610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-50c2ef77-848a-473b-94b0-7539631dfe84 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1513 microversion: 2.1 time: 0.296935 Sep 19 14:56:41.681174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 433/543] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:41.685829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.686426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.692334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.692924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.693270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.693967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.694448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.694895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.824524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:41.832123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a8e1cfba-a1eb-4e28-abc6-2aab7d234ee4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1555 microversion: 2.1 time: 0.149981 Sep 19 14:56:41.832672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 434/544] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:41.854522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.855031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.860903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.861377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.861803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.862500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.862933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.863350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.940297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b62baff0-e93b-4a63-a106-102ffac16ac5 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089423 Sep 19 14:56:41.940879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 435/545] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:41.946050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:41.946657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:41.952865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.953348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.953777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:41.954502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:41.954949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:41.955364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.085560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.089793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:42.096086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-778b4c86-f80a-40ab-9d3e-5c0269ffb9bd tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1724 microversion: 2.1 time: 0.154175 Sep 19 14:56:42.096662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 436/546] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:41 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:42.652300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.652972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.660362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.660854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.661290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.662481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.662936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.663360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.695130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-edd597db-bbda-4db9-a91e-415f25b4d1c2 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments/3ddab806-2e95-4948-86a1-12edee9e3300" status: 200 len: 194 microversion: 2.20 time: 0.046717 Sep 19 14:56:42.695651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 437/547] 10.222.0.60 () {60 vars in 1454 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments/3ddab806-2e95-4948-86a1-12edee9e3300 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:56:42.704537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.705451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.711816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.711816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.712296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.713009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.713467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.713946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.882351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:42.893028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-df6f7f1c-da8d-4c08-ab09-f3e376553a63 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1513 microversion: 2.1 time: 0.192000 Sep 19 14:56:42.904079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 438/548] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:42 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:42.904079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:42.904079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:42.910983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.911960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.912896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:42.913838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:42.914306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:42.914778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.003171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lazy-loading 'services' on Instance uuid 7c86857b-a653-4c5f-97c0-643793ca4d35 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:43.089420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5952677c-d642-4556-8eea-8ff34504d9ba tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments/3ddab806-2e95-4948-86a1-12edee9e3300" status: 202 len: 0 microversion: 2.20 time: 0.193397 Sep 19 14:56:43.095349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 439/549] 10.222.0.60 () {60 vars in 1457 bytes} [Mon Sep 19 14:56:42 2022] DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments/3ddab806-2e95-4948-86a1-12edee9e3300 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:56:43.097456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-537ed10d-2011-4197-9f07-03b315d3769b req-27a45f60-4389-4407-82b4-33ec1f211aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf690c71-c2d4-432f-b912-4d9b0918f3af", "tag": "88eb59a5-7768-48b5-bf92-78da65a37cc5"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:43.108097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-537ed10d-2011-4197-9f07-03b315d3769b req-27a45f60-4389-4407-82b4-33ec1f211aa3 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.108578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-537ed10d-2011-4197-9f07-03b315d3769b req-27a45f60-4389-4407-82b4-33ec1f211aa3 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.109008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-537ed10d-2011-4197-9f07-03b315d3769b req-27a45f60-4389-4407-82b4-33ec1f211aa3 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.120952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-537ed10d-2011-4197-9f07-03b315d3769b req-27a45f60-4389-4407-82b4-33ec1f211aa3 service nova] Creating event network-changed:88eb59a5-7768-48b5-bf92-78da65a37cc5 for instance cf690c71-c2d4-432f-b912-4d9b0918f3af on hv-cinder-75670 Sep 19 14:56:43.126234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-537ed10d-2011-4197-9f07-03b315d3769b req-27a45f60-4389-4407-82b4-33ec1f211aa3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032760 Sep 19 14:56:43.127159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 440/550] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:43.132945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:43.135174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:43.141554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.142035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.142467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.143168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.143619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.144169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.174670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-92b99cd6-2116-4af4-9982-5012aaca67d8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046261 Sep 19 14:56:43.175241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 441/551] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Sep 19 14:56:43 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:56:43.180327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:43.180929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:43.186907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.187398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.187870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.188556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.189009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.189436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.325663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:43.334500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2dd61484-16ce-4618-aef2-7d430a4149ac tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1730 microversion: 2.1 time: 0.158197 Sep 19 14:56:43.335470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 442/552] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:43 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:43.357964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:43.358519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:43.365856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.368206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.368670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.369442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.369909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.370683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.451989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2bca071a-f8c4-4a3a-9d1e-6266fa2c8c6b tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097885 Sep 19 14:56:43.452622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 443/553] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:56:43 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:43.920395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:43.921116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:43.971583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.972155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.972810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:43.973569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:43.974043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:43.975009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.411243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:44.418958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3b037358-668b-42de-977a-5dbffe0b7e40 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1513 microversion: 2.1 time: 0.505955 Sep 19 14:56:44.419535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 444/554] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:43 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:44.424174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-dfe3262d-10ab-4b89-8860-40c7698bbee8 req-fbcb0f47-ed80-417c-92a4-3c3521e908fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef328ddb-042d-42c5-97cd-1497db04bd48", "name": "network-vif-unplugged", "status": "completed", "tag": "07dfda96-d929-409d-af60-17ff55783a50"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:44.444061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-dfe3262d-10ab-4b89-8860-40c7698bbee8 req-fbcb0f47-ed80-417c-92a4-3c3521e908fe service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.444540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-dfe3262d-10ab-4b89-8860-40c7698bbee8 req-fbcb0f47-ed80-417c-92a4-3c3521e908fe service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.444967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-dfe3262d-10ab-4b89-8860-40c7698bbee8 req-fbcb0f47-ed80-417c-92a4-3c3521e908fe service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.456732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-dfe3262d-10ab-4b89-8860-40c7698bbee8 req-fbcb0f47-ed80-417c-92a4-3c3521e908fe service nova] Creating event network-vif-unplugged:07dfda96-d929-409d-af60-17ff55783a50 for instance ef328ddb-042d-42c5-97cd-1497db04bd48 on hv-cinder-75670 Sep 19 14:56:44.461673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-dfe3262d-10ab-4b89-8860-40c7698bbee8 req-fbcb0f47-ed80-417c-92a4-3c3521e908fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040998 Sep 19 14:56:44.462271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 445/555] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:44.467585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:44.469839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:44.476213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.476603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.477031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.477724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:44.478169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:44.478587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:44.509606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4d83d324-3279-496c-89b6-1b9aa3b0a513 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046141 Sep 19 14:56:44.510175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 446/556] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Sep 19 14:56:44 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:56:45.261671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-173cc0b8-58aa-4858-8f51-c746425bd4bc req-0f39d3c8-1709-4c08-9fe8-924f9ec95e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8318af-931d-4569-8264-7a5d1ded7553", "tag": "09e588d6-8aef-4eee-8923-67987434a697"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:45.275943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-173cc0b8-58aa-4858-8f51-c746425bd4bc req-0f39d3c8-1709-4c08-9fe8-924f9ec95e2b service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.276632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-173cc0b8-58aa-4858-8f51-c746425bd4bc req-0f39d3c8-1709-4c08-9fe8-924f9ec95e2b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.277230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-173cc0b8-58aa-4858-8f51-c746425bd4bc req-0f39d3c8-1709-4c08-9fe8-924f9ec95e2b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.293625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-173cc0b8-58aa-4858-8f51-c746425bd4bc req-0f39d3c8-1709-4c08-9fe8-924f9ec95e2b service nova] Creating event network-changed:09e588d6-8aef-4eee-8923-67987434a697 for instance 8c8318af-931d-4569-8264-7a5d1ded7553 on hv-cinder-75670 Sep 19 14:56:45.304699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-173cc0b8-58aa-4858-8f51-c746425bd4bc req-0f39d3c8-1709-4c08-9fe8-924f9ec95e2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046202 Sep 19 14:56:45.305915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 447/557] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:56:45.449114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:45.450263 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:45.456765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.457556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.458002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.458731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:45.459451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:45.460119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:45.980915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:45.988731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f0a128e8-4a5a-4174-b5d4-afafde57f6be tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1513 microversion: 2.1 time: 0.543926 Sep 19 14:56:45.996609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 448/558] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:45 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1513 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:45.996609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:45.996609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:46.002346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.002821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.003338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.004031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.004396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.004820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.052563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3646b8df-b20f-4e42-958c-b0a551280d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061814 Sep 19 14:56:46.052815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 449/559] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Sep 19 14:56:45 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:56:46.137975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:46.138630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:46.144803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.146046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.146046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.146799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.147474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.147932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.179503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:56:46.285809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c4c065e4-2a35-4a5a-8483-0c93a1a63177 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 204 len: 0 microversion: 2.20 time: 0.151896 Sep 19 14:56:46.287935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 450/560] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Sep 19 14:56:46 2022] DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 14:56:46.298575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:46.299172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:46.305843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.306327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.307051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.307744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:46.308226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:46.308648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:46.442620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:46.451135 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:46.452608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:46.453749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ad779171-9646-487e-95ee-db3571376b54 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.160658 Sep 19 14:56:46.454294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 451/561] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:46 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:56:47.014768 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.015337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.022014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.022497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.022935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.023624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.024120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.024548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.053994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.054472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.054909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.055358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lazy-loading 'fault' on Instance uuid ef328ddb-042d-42c5-97cd-1497db04bd48 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:47.096395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.104107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b37c90d9-6df1-4d45-813e-0c63738729e3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1308 microversion: 2.1 time: 0.093252 Sep 19 14:56:47.104664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 452/562] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:47 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:47.321446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8318af-931d-4569-8264-7a5d1ded7553", "tag": "09e588d6-8aef-4eee-8923-67987434a697"}, {"server_uuid": "ef328ddb-042d-42c5-97cd-1497db04bd48", "name": "network-vif-deleted", "tag": "07dfda96-d929-409d-af60-17ff55783a50"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:47.332521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.333005 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.333446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.337281 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:47.347157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] Creating event network-changed:09e588d6-8aef-4eee-8923-67987434a697 for instance 8c8318af-931d-4569-8264-7a5d1ded7553 on hv-cinder-75670 Sep 19 14:56:47.347672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] Creating event network-vif-deleted:07dfda96-d929-409d-af60-17ff55783a50 for instance ef328ddb-042d-42c5-97cd-1497db04bd48 on hv-cinder-75670 Sep 19 14:56:47.354266 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-2208463c-bd26-4a95-9d0a-aeebda942e6d req-9645c588-0990-49e7-88f8-92637c0ea9e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037672 Sep 19 14:56:47.354853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 453/563] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:47.480890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:47.481586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:47.488360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.488855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.489296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.490502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:47.490962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:47.491391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:47.620090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.628270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.629739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:47.631491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-19686af8-7c9c-4376-a9db-61d495efed58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.154884 Sep 19 14:56:47.632077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 454/564] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:47 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:48.127548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:48.128229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:48.134294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.134884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.135214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.135936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.136392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.136851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.168688 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.169184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.169621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.170074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lazy-loading 'fault' on Instance uuid ef328ddb-042d-42c5-97cd-1497db04bd48 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:48.225832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b677827f1648319b0616aec4db66e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeec00f3a752480cb9ac3a670bcb297d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.233476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6dd2dc29-dbe1-4df2-9602-190eb67034f3 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 200 len: 1308 microversion: 2.1 time: 0.110811 Sep 19 14:56:48.234034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 455/565] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:48 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:56:48.657151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:48.657873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:48.664318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.664801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.665273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.665971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:48.666426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:48.666852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:48.970171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.979543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.981049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:48.982810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fb23b8d7-30a0-4b40-9cf3-efc43d5ed9b6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1724 microversion: 2.20 time: 0.329777 Sep 19 14:56:48.983387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 456/566] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:48 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:49.256659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:49.257276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] [instance: ef328ddb-042d-42c5-97cd-1497db04bd48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:49.263258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.263750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.264243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.264943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.265398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.265825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.283734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] HTTP exception thrown: Instance ef328ddb-042d-42c5-97cd-1497db04bd48 could not be found. Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Request method failure captured: Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 HTTP/1.1 Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKrvdwLjf_egShbpkGxKBvoD8h3XfLDxVwMGc3dRinl7cod3aiz6DPfkIdNVgTpd0YV-gmuQ1G7HYakA6h7Pk6SmzG-IGzvCB0HD78IvGKk8YWPz4Pr_OQqZO57S3MhC6x6rcdFNKTy7HjK9V9XIBqHkGEDE3YrXnNjQFAEPKllof0 Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: aeec00f3a752480cb9ac3a670bcb297d Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1394909078 Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:56:49.285429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_aeec00f3a752480cb9ac3a670bcb297d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aeec00f3a752480cb9ac3a670bcb297d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/aeec00f3a752480cb9ac3a670bcb297d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/aeec00f3a752480cb9ac3a670bcb297d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1394909078 Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: aeec00f3a752480cb9ac3a670bcb297d Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1394909078 Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesSnapshotTestJSON-1394909078-project Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: c0b677827f1648319b0616aec4db66e6 Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1394909078-project Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance ef328ddb-042d-42c5-97cd-1497db04bd48 could not be found. Sep 19 14:56:49.287286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'ef328ddb-042d-42c5-97cd-1497db04bd48'} Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef328ddb-042d-42c5-97cd-1497db04bd48 could not be found. Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:49.288099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef328ddb-042d-42c5-97cd-1497db04bd48 could not be found. Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef328ddb-042d-42c5-97cd-1497db04bd48 could not be found. Sep 19 14:56:49.289483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:49.291414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] Returning 404 to user: Instance ef328ddb-042d-42c5-97cd-1497db04bd48 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:49.291414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ebed842b-d083-499c-97ae-e62406a23316 tempest-VolumesSnapshotTestJSON-1394909078 tempest-VolumesSnapshotTestJSON-1394909078-project] 10.222.0.60 "GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48" status: 404 len: 111 microversion: 2.1 time: 0.034152 Sep 19 14:56:49.291414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 457/567] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:56:49 2022] GET /compute/v2.1/servers/ef328ddb-042d-42c5-97cd-1497db04bd48 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:56:49.628528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-4a690bf8-6218-49ba-b7af-d3ca41f1b5ff req-a2d532de-427f-4693-ba96-ea0c866abd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c86857b-a653-4c5f-97c0-643793ca4d35", "name": "network-vif-deleted", "tag": "ab5b2076-79f4-47d7-ad9b-ce74dcb18620"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:49.639503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4a690bf8-6218-49ba-b7af-d3ca41f1b5ff req-a2d532de-427f-4693-ba96-ea0c866abd71 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:49.640022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4a690bf8-6218-49ba-b7af-d3ca41f1b5ff req-a2d532de-427f-4693-ba96-ea0c866abd71 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:49.640436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4a690bf8-6218-49ba-b7af-d3ca41f1b5ff req-a2d532de-427f-4693-ba96-ea0c866abd71 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:49.652957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-4a690bf8-6218-49ba-b7af-d3ca41f1b5ff req-a2d532de-427f-4693-ba96-ea0c866abd71 service nova] Creating event network-vif-deleted:ab5b2076-79f4-47d7-ad9b-ce74dcb18620 for instance 7c86857b-a653-4c5f-97c0-643793ca4d35 on hv-cinder-75670 Sep 19 14:56:49.660470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-4a690bf8-6218-49ba-b7af-d3ca41f1b5ff req-a2d532de-427f-4693-ba96-ea0c866abd71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 Sep 19 14:56:49.664245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 458/568] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:50.008907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:50.009877 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:50.016966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.017460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.017900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.018636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.019094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.019522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.050498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:50.050980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:50.051445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:50.051912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lazy-loading 'fault' on Instance uuid 7c86857b-a653-4c5f-97c0-643793ca4d35 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:56:50.093990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.102662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.104131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:50.105286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a152ace2-aa61-416d-b9fc-961d09f5d1f9 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 200 len: 1371 microversion: 2.20 time: 0.101238 Sep 19 14:56:50.105837 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 459/569] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:50 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:51.131560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:51.132286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:51.139003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:51.139483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:51.139945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:51.140640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:51.141084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:51.141503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:51.154631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] HTTP exception thrown: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Request method failure captured: Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 HTTP/1.1 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIt3HdfmD0GWFHDLwkkL4efYDM8eunK6mORqOVuUIvSbIwo5ebxzFwMU997ngUCz8sPYpGAQ3xNfOp8OEtcsnWus7fxZbxk9Xwyjo_fHeKMT2ja8chmqVXrJImrXR5t0sNEMnua6UWhjPluxezsvCQqXv2pwMnVdFINshjk-6-9ULE Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:56:51.156339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db03071b1326441bb9571432be926bf5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db03071b1326441bb9571432be926bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: b2c40600d2fd4eea8e4ba999050abd73 Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:56:51.157994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '7c86857b-a653-4c5f-97c0-643793ca4d35'} Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:56:51.158913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:56:51.160306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:56:51.161684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Returning 404 to user: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:56:51.161684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-30a733a4-4694-4d71-8923-7b48fc03496d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 404 len: 111 microversion: 2.20 time: 0.030784 Sep 19 14:56:51.161684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 460/570] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:51 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:56:51.166793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1dffd155-edf6-446f-9ac8-5b0ebc21b314 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '.version_select at 0x7f9f3d16c9d0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:51.179102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:56:51.188077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1dffd155-edf6-446f-9ac8-5b0ebc21b314 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873823172" status: 204 len: 0 microversion: 2.20 time: 0.024909 Sep 19 14:56:51.188645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 461/571] 10.222.0.60 () {60 vars in 1262 bytes} [Mon Sep 19 14:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873823172 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 14:56:51.830253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d2ddb8c4-9543-4536-833b-76a795744958 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'create', calling method: .version_select at 0x7f9f3988ab80>, body: {"keypair": {"name": "tempest-keypair-183801970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUj0ueKTf5Y+dakrq8sNvq3P2Ah20f6V1yu1qeXYOYPh0Vrn3MJQhioGtiH7XVf5TSY6SpJqAu3QjtYpG2KVuuO4xF9beHuS7GHh1GsymUwi5v0G298aDNsR0haZb1shQ=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:51.846851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-d2ddb8c4-9543-4536-833b-76a795744958 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for project db03071b1326441bb9571432be926bf5. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:51.850890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-d2ddb8c4-9543-4536-833b-76a795744958 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for user b2c40600d2fd4eea8e4ba999050abd73 and project db03071b1326441bb9571432be926bf5. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:51.873582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d2ddb8c4-9543-4536-833b-76a795744958 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047182 Sep 19 14:56:51.874189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 462/572] 10.222.0.60 () {62 vars in 1200 bytes} [Mon Sep 19 14:56:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 19 14:56:53.144175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-907859572", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e38065f1-625e-45cf-a407-4391527fb143"}], "security_groups": [{"name": "tempest-securitygroup--1251210156"}], "key_name": "tempest-keypair-183801970", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:53.249993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] validate_networks() for [('e38065f1-625e-45cf-a407-4391527fb143', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:56:53.621527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:56:53.621979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:56:53.622461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:56:53.622899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:56:53.623315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:56:53.632599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:53.633088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:53.633523 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:53.634256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:53.634738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:53.635174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:53.653614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for project db03071b1326441bb9571432be926bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:56:53.657639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Getting quotas for user b2c40600d2fd4eea8e4ba999050abd73 and project db03071b1326441bb9571432be926bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:56:53.669325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:56:53.671737 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:56:53.720530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-28643a4b-2dd1-4eea-9f7d-ac5351624fe5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.580655 Sep 19 14:56:53.721185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 463/573] 10.222.0.60 () {62 vars in 1188 bytes} [Mon Sep 19 14:56:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 14:56:53.732580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c0fca4d5-08b8-492d-bc28-0510e8805477 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:53.733186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c0fca4d5-08b8-492d-bc28-0510e8805477 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:53.792715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c0fca4d5-08b8-492d-bc28-0510e8805477 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:53.801620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c0fca4d5-08b8-492d-bc28-0510e8805477 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:53.803156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c0fca4d5-08b8-492d-bc28-0510e8805477 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:53.804293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c0fca4d5-08b8-492d-bc28-0510e8805477 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1280 microversion: 2.20 time: 0.075875 Sep 19 14:56:53.815926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 464/574] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:53 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:54.830571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:54.831216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:54.838297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.838797 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.839235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.839981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:54.840662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:54.840896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:54.907375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.915737 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.917238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:54.918331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3400169d-8a59-4d3b-a065-1099a5169935 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1332 microversion: 2.20 time: 0.092244 Sep 19 14:56:54.918881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 465/575] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:54 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:55.944897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:55.945585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:55.952577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.953011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.953447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:55.954156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:55.954617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:55.955041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.155133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.163288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.164781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:56.165900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d9891132-b09c-4a74-814c-be5753adbc93 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.225819 Sep 19 14:56:56.166491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 466/576] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:55 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:56.516363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-70fcb000-e51d-4983-aaf2-8e8e5b4e96c9 req-a0d6b0d5-5c6d-4a2f-9b8f-e3df43581775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:56:56.534676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-70fcb000-e51d-4983-aaf2-8e8e5b4e96c9 req-a0d6b0d5-5c6d-4a2f-9b8f-e3df43581775 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:56.535161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-70fcb000-e51d-4983-aaf2-8e8e5b4e96c9 req-a0d6b0d5-5c6d-4a2f-9b8f-e3df43581775 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:56.535599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-70fcb000-e51d-4983-aaf2-8e8e5b4e96c9 req-a0d6b0d5-5c6d-4a2f-9b8f-e3df43581775 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:56.548226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-70fcb000-e51d-4983-aaf2-8e8e5b4e96c9 req-a0d6b0d5-5c6d-4a2f-9b8f-e3df43581775 service nova] Creating event network-changed:274e690b-1c6b-4790-9dc2-5dbe545e77ae for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 on hv-cinder-75670 Sep 19 14:56:56.552722 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-70fcb000-e51d-4983-aaf2-8e8e5b4e96c9 req-a0d6b0d5-5c6d-4a2f-9b8f-e3df43581775 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039585 Sep 19 14:56:56.553315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 467/577] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:56:57.193373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:57.194164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:57.200519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.201012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.201458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.202216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:57.202732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:57.203173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:57.340255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:57.348333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:57.349791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:57.350900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9c05f81f-1a9a-4522-8542-6bdf5e0064b7 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.163041 Sep 19 14:56:57.351456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 468/578] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:57 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:58.376832 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:58.377469 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:58.384395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:58.384874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:58.385305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:58.385991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:58.386442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:58.386865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:58.514406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:58.523037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:58.524647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:58.525762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d00faa08-71df-40a9-b64e-b78ead946766 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.152898 Sep 19 14:56:58.526317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 469/579] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:58 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:56:59.550634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:56:59.551320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:56:59.558890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:59.559451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:59.559996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.560734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:56:59.561231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:56:59.561693 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:56:59.693147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:59.701097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:59.702542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:56:59.703634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-42b6fc3a-1683-46e1-9ec1-79443af8b133 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.156954 Sep 19 14:56:59.704228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 470/580] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:56:59 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:00.730124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:00.730802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:00.737231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:00.737718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:00.738152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:00.738849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:00.739315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:00.740407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:00.868466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.876519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.877999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:00.879131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1c10e656-75a6-44d1-9479-c447b9175f95 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.152944 Sep 19 14:57:00.879697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 471/581] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:00 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:01.904591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:01.905248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:01.912086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:01.912567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:01.913001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:01.913692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:01.914163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:01.914586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:02.044831 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:02.053110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:02.054586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:02.055706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f0a6cd01-e078-4629-bfc1-cc84bbbbb2e6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.155053 Sep 19 14:57:02.056296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 472/582] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:01 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:03.081619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:03.082228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:03.088879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:03.089471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:03.089799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:03.090507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:03.090968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:03.091399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:03.223288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.231364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.232857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:03.233960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b8e325b0-512f-4577-b54c-1f7496488867 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.156294 Sep 19 14:57:03.234516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 473/583] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:03 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:04.154360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-be5ddd0d-7b62-46fc-ac50-2388ba23ebe1 req-a7980f70-2eab-4ffd-852d-8fb3ad20e247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "name": "network-vif-plugged", "status": "completed", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:04.160009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:04.161013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=12 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:04.170368 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-be5ddd0d-7b62-46fc-ac50-2388ba23ebe1 req-a7980f70-2eab-4ffd-852d-8fb3ad20e247 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.170848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-be5ddd0d-7b62-46fc-ac50-2388ba23ebe1 req-a7980f70-2eab-4ffd-852d-8fb3ad20e247 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.171289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-be5ddd0d-7b62-46fc-ac50-2388ba23ebe1 req-a7980f70-2eab-4ffd-852d-8fb3ad20e247 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:04.186109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-be5ddd0d-7b62-46fc-ac50-2388ba23ebe1 req-a7980f70-2eab-4ffd-852d-8fb3ad20e247 service nova] Creating event network-vif-plugged:274e690b-1c6b-4790-9dc2-5dbe545e77ae for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 on hv-cinder-75670 Sep 19 14:57:04.191165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-be5ddd0d-7b62-46fc-ac50-2388ba23ebe1 req-a7980f70-2eab-4ffd-852d-8fb3ad20e247 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041167 Sep 19 14:57:04.191866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 474/584] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:04.260304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:04.260986 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:04.267140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.267618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.268169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:04.268963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:04.269474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:04.269898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:04.447661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:04.455792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:04.457319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:04.459047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-27ccf96d-2ead-4b37-bbcf-7c63b7cd9dc4 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.202393 Sep 19 14:57:04.459598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 475/585] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:04 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:05.484915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:05.485602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:05.492599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:05.493110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:05.493525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:05.494227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:05.494688 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:05.495119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:05.624722 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.628427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:05.634752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.636249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:05.637375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9764894c-2030-4f51-9563-018ccad17864 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1406 microversion: 2.20 time: 0.156747 Sep 19 14:57:05.637960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 476/586] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:05 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:06.664917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:06.665869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:06.673777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.674412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.674847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.675583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.676064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.676617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.810741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:06.819418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:06.820898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:06.822048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-25a21e1f-baa6-43f0-b426-77fca6bb3b11 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1599 microversion: 2.20 time: 0.163548 Sep 19 14:57:06.822607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 477/587] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:06 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:06.846032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:06.846518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:06.852370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.852968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.853292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.854007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:06.854488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:06.854915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:06.932105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d59af9de-3888-4cc6-bf98-e6370601db25 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089473 Sep 19 14:57:06.932796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 478/588] 10.222.0.60 () {60 vars in 1316 bytes} [Mon Sep 19 14:57:06 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 14:57:07.865047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-a78dd51d-53ca-4ddc-b842-0d36e280baf6 req-23270dd1-ad5a-43d9-b6be-8746c38c7c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:07.874319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a78dd51d-53ca-4ddc-b842-0d36e280baf6 req-23270dd1-ad5a-43d9-b6be-8746c38c7c8e service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:07.874789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a78dd51d-53ca-4ddc-b842-0d36e280baf6 req-23270dd1-ad5a-43d9-b6be-8746c38c7c8e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:07.875254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-a78dd51d-53ca-4ddc-b842-0d36e280baf6 req-23270dd1-ad5a-43d9-b6be-8746c38c7c8e service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:07.887090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-a78dd51d-53ca-4ddc-b842-0d36e280baf6 req-23270dd1-ad5a-43d9-b6be-8746c38c7c8e service nova] Creating event network-changed:274e690b-1c6b-4790-9dc2-5dbe545e77ae for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 on hv-cinder-75670 Sep 19 14:57:07.892312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-a78dd51d-53ca-4ddc-b842-0d36e280baf6 req-23270dd1-ad5a-43d9-b6be-8746c38c7c8e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Sep 19 14:57:07.892903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 479/589] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:14.737665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:14.738378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:14.746246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:14.746739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:14.747183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:14.747918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:14.748519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:14.748957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:14.829458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lazy-loading 'services' on Instance uuid f41656a6-4409-4e9a-9b29-066443ea6426 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:14.903851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ea69f67a-5154-41cd-a6ce-a196640495ca tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-volume_attachments/471ce30e-9100-494b-92b2-0ed85818398f" status: 202 len: 0 microversion: 2.1 time: 0.171372 Sep 19 14:57:14.904845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 480/590] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:57:14 2022] DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-volume_attachments/471ce30e-9100-494b-92b2-0ed85818398f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:57:16.031779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-64b156d9-e883-4912-9c31-0844722a7792 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:16.039164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64b156d9-e883-4912-9c31-0844722a7792 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:16.039644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64b156d9-e883-4912-9c31-0844722a7792 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:16.040096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64b156d9-e883-4912-9c31-0844722a7792 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:16.061854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-64b156d9-e883-4912-9c31-0844722a7792 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Going to try to stop instance {{(pid=126870) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 14:57:16.104616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-64b156d9-e883-4912-9c31-0844722a7792 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action" status: 202 len: 0 microversion: 2.1 time: 0.076900 Sep 19 14:57:16.105360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 481/591] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:57:16 2022] POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:57:16.114725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:16.115070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:16.121598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:16.122200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:16.122728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:16.123537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:16.124127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:16.124816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:16.267972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:16.276469 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4a10e996-a881-4eba-890c-3fd594455b6e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.166522 Sep 19 14:57:16.277033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 482/592] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:16 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:17.300944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:17.302126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:17.308748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:17.309227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:17.309652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:17.310334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:17.310781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:17.311202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:17.438447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:17.447210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-93c070ed-503b-4f65-b924-5d9dc4158b4f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.150303 Sep 19 14:57:17.447815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 483/593] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:17 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:18.471746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:18.472459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:18.479728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.480271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.480713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:18.481417 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:18.481875 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:18.482305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:18.614637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:18.622590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-25e76d46-76e9-40f0-ade3-6c58846a9bba tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.154833 Sep 19 14:57:18.623151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 484/594] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:18 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:19.645963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:19.646675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:19.652965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:19.653441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:19.653874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:19.654554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:19.655006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:19.655424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:19.784242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:19.792558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a0367b93-8465-4682-92b2-720d2e3f6b80 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.150540 Sep 19 14:57:19.793124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 485/595] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:19 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:20.817658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:20.818340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:20.825057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:20.825546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:20.826050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:20.826762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:20.827216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:20.827641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:21.187630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:21.196167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5099e5d3-8af7-4a00-b3d9-409cfb5a5f01 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.382357 Sep 19 14:57:21.196800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 486/596] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:20 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:22.219699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:22.220328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:22.222609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:22.229847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.230531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.231053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.231793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:22.232302 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:22.232756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:22.367285 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:22.374953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4c4f38ed-d64f-4bdd-9e03-d809aeeccb99 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.159245 Sep 19 14:57:22.375524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 487/597] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:22 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:23.399332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:23.399979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:23.406468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:23.406943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:23.407375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:23.408102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:23.408549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:23.408971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:23.540006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:23.547910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9de9cf39-1453-4463-8555-d960643795e0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.153139 Sep 19 14:57:23.548509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 488/598] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:23 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:24.572527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:24.573256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:24.579599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:24.580118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:24.580549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:24.581244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:24.581685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:24.582105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:24.714377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:24.723104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0a89a712-6281-4376-82a8-0b7e55bb74a0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.154373 Sep 19 14:57:24.723676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 489/599] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:24 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:25.756091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:25.756091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:25.766458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:25.767194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:25.767890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:25.768998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:25.769741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:25.771030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:25.909741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:25.917914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7b462983-e4f6-4c72-b83e-63c1c25dfb81 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1677 microversion: 2.1 time: 0.168818 Sep 19 14:57:25.918572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 490/600] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:25 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:25.996608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:25.997031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:26.003140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.003700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.004250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.005566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.006172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.006394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.096644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'services' on Instance uuid 8c8318af-931d-4569-8264-7a5d1ded7553 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:26.174910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4446c76a-fed4-4f92-a182-78308197dd22 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments/2ab36061-df50-4b48-a9bf-13335ddb94e6" status: 202 len: 0 microversion: 2.1 time: 0.182195 Sep 19 14:57:26.175580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 491/601] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:57:25 2022] DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments/2ab36061-df50-4b48-a9bf-13335ddb94e6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:57:26.185354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:26.187740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:26.195296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.195788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.196254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.198146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.198146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.198146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.201828 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:26.231445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cf1a89bc-2c58-448f-baad-b68e4c0f2c17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050651 Sep 19 14:57:26.232250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 492/602] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:57:26 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:26.943729 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:26.944466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:26.950898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.951384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.951848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:26.952584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:26.953041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:26.953473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.095676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:27.104121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-99089949-0010-4185-bacf-513113ff924a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1654 microversion: 2.1 time: 0.164833 Sep 19 14:57:27.104695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 493/603] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:26 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:27.127711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-96dd2865-50ab-4128-aee8-e6c071e73a84 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:27.133747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96dd2865-50ab-4128-aee8-e6c071e73a84 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.134374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96dd2865-50ab-4128-aee8-e6c071e73a84 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.134748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-96dd2865-50ab-4128-aee8-e6c071e73a84 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.157332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-96dd2865-50ab-4128-aee8-e6c071e73a84 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Going to try to start instance {{(pid=126870) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 14:57:27.199622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-96dd2865-50ab-4128-aee8-e6c071e73a84 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action" status: 202 len: 0 microversion: 2.1 time: 0.075472 Sep 19 14:57:27.200299 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 494/604] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 14:57:27 2022] POST /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:57:27.208804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:27.209564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:27.216205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.216693 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.217279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.218097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.218637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.219106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.434659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:27.442989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-327bc16a-afe5-4abf-bf93-7da52e45da9c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1663 microversion: 2.1 time: 0.238297 Sep 19 14:57:27.443554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 495/605] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:27 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1663 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:27.448134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:27.450329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:27.456080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.456562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.457001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.457737 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.458186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.458603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.487873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9c3dde20-5e95-44f0-95a1-b410ce8203a5 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043238 Sep 19 14:57:27.491878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 496/606] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:57:27 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:57:27.563839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:27.564349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:27.570973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.571450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.571927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.572835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.573126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.573547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.598602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:57:27.678256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c05f18bf-77a7-4722-b9f0-68869d359c5e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 204 len: 0 microversion: 2.1 time: 0.117958 Sep 19 14:57:27.678961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 497/607] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:27 2022] DELETE /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:57:27.687754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:27.688488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:27.695068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.695558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.696025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.696815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:27.697183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:27.697603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:27.839799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:27.848680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3150ec0c-6d98-41c9-965f-518caa5674af tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1690 microversion: 2.1 time: 0.164649 Sep 19 14:57:27.849246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 498/608] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:27 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:28.466503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:28.467190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:28.474215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:28.474692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:28.475121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:28.475801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:28.476277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:28.476695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:28.606817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:28.615057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a93f2a46-7e50-472c-b6f8-f558ce700221 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1663 microversion: 2.1 time: 0.152447 Sep 19 14:57:28.615641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 499/609] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:28 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:28.872042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:28.872558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:28.878540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:28.879085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:28.879520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:28.880232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:28.880682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:28.881100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.014060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:29.022410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1aa3b83e-98c4-4088-b848-894554e11a60 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1690 microversion: 2.1 time: 0.154363 Sep 19 14:57:29.022975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 500/610] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:28 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:29.638102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:29.638771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:29.646067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.646568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.647038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.647765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.648297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.648727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.778899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:29.786770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4a79a265-19b6-4b3a-ba37-80196120be1b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1663 microversion: 2.1 time: 0.152644 Sep 19 14:57:29.787357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 501/611] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:29 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:29.792010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:29.792529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:29.799321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.800060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.800708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.802186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:29.802787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:29.803242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:29.830398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f3310ff0-33ae-4a4e-a538-ef3987449c9d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/ips" status: 200 len: 148 microversion: 2.1 time: 0.041823 Sep 19 14:57:29.831047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 502/612] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:57:29 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:30.051251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:30.051251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:30.056638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:30.057575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:30.058246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:30.059107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:30.059451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:30.059945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:30.208004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:30.215665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fd6bb740-c026-4311-b403-ec43409672de tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1690 microversion: 2.1 time: 0.173364 Sep 19 14:57:30.216262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 503/613] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:30 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:30.811238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:30.811945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:30.819637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:30.820165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:30.820607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:30.821303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:30.821807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:30.822305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:30.953571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:30.961379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c2a110f2-d605-4021-bc0b-15f6fb6c8041 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1663 microversion: 2.1 time: 0.154310 Sep 19 14:57:30.961938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 504/614] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:30 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:31.178767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc2609ad-c7f9-4435-8a54-ff139bb9eb03"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:31.181133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:31.187270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.187753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.188235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.188989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.189397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.189805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.427346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:31.448583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-eb23ddcf-da55-4d8d-985d-29398013ea77 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274297 Sep 19 14:57:31.449177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 505/615] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:57:31 2022] POST /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:31.459765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:31.460979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:31.472084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.472621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.473608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.474420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.474880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.475311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.863678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:31.871466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4809b15d-af9b-4e8a-a0ac-f627d9d74c86 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1690 microversion: 2.1 time: 0.418405 Sep 19 14:57:31.872035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 506/616] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:31 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1690 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:31.986661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:31.987194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:31.994255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.994782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.995223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:31.995952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:31.996410 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:31.996844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:32.133665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:32.141545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-efe17b22-d0d0-418c-9a61-7bdf8903f96f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1663 microversion: 2.1 time: 0.160308 Sep 19 14:57:32.142027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 507/617] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:31 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:32.897066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:32.897970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:32.904872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:32.905363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:32.905805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:32.906525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:32.907002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:32.907414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.159529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:33.167481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-df2f3fd0-a251-4614-8724-1816d653faa6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1690 microversion: 2.1 time: 0.274879 Sep 19 14:57:33.168080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 508/618] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:32 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:33.172536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:33.173135 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:33.179668 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:33.180175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:33.180603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.181296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:33.181748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:33.182420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.409317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:33.420870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0e4a3ced-1b16-44c0-98fd-431d8f6e922e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1667 microversion: 2.1 time: 0.251667 Sep 19 14:57:33.421638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 509/619] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:33 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1667 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:33.671449 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-ba52848a-916e-4fb6-abfc-ce6a6f979ad4 req-afd046c3-be8b-469a-bf1f-3b31c5cd4787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8318af-931d-4569-8264-7a5d1ded7553", "name": "network-vif-deleted", "tag": "09e588d6-8aef-4eee-8923-67987434a697"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:33.683250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ba52848a-916e-4fb6-abfc-ce6a6f979ad4 req-afd046c3-be8b-469a-bf1f-3b31c5cd4787 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:33.684027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ba52848a-916e-4fb6-abfc-ce6a6f979ad4 req-afd046c3-be8b-469a-bf1f-3b31c5cd4787 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:33.684386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-ba52848a-916e-4fb6-abfc-ce6a6f979ad4 req-afd046c3-be8b-469a-bf1f-3b31c5cd4787 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:33.698303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-ba52848a-916e-4fb6-abfc-ce6a6f979ad4 req-afd046c3-be8b-469a-bf1f-3b31c5cd4787 service nova] Creating event network-vif-deleted:09e588d6-8aef-4eee-8923-67987434a697 for instance 8c8318af-931d-4569-8264-7a5d1ded7553 on hv-cinder-75670 Sep 19 14:57:33.704330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-ba52848a-916e-4fb6-abfc-ce6a6f979ad4 req-afd046c3-be8b-469a-bf1f-3b31c5cd4787 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Sep 19 14:57:33.711040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 510/620] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:34.194505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:34.195205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:34.202945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.203648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.204164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:34.205234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.205852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.206438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:34.241300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:34.241887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:34.242391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:34.242901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'fault' on Instance uuid 8c8318af-931d-4569-8264-7a5d1ded7553 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:34.284841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:34.293558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3355f6fb-9086-4504-93a9-45cc3620587f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 200 len: 1335 microversion: 2.1 time: 0.104843 Sep 19 14:57:34.294136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 511/621] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:34 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:35.317448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:35.318077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: 8c8318af-931d-4569-8264-7a5d1ded7553] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:35.325099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:35.325586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:35.326028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:35.326725 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:35.327179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:35.327609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:35.341488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] HTTP exception thrown: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 could not be found. Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Request method failure captured: Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 HTTP/1.1 Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIupeH_kuHISBrwHOUes8TECc-yxkq7b0k3DfsWggDcApN4As7X5NzdGOoPirf2u3aPbJvApSy3DvooofC8KEV4NI5rcW5jEkWYQIM7pZDnZpnJf_mRnNsu3-t8RbAU_CzK_dNp42W3_VdekEppHEJ5_n4Rv8cZMzkSm_fGMP7mlmU Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:57:35.343138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73c223bd20fc43eca4c1cd0921f7906d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 1cccf354894c4311b7710d8a65682eeb Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 could not be found. Sep 19 14:57:35.344783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '8c8318af-931d-4569-8264-7a5d1ded7553'} Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 could not be found. Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:35.345634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 could not be found. Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 could not be found. Sep 19 14:57:35.346913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:35.348640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Returning 404 to user: Instance 8c8318af-931d-4569-8264-7a5d1ded7553 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:35.348640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-12212bc3-c00a-4313-8704-cb7f0fbf9a17 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553" status: 404 len: 111 microversion: 2.1 time: 0.031127 Sep 19 14:57:35.348640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 512/622] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:35 2022] GET /compute/v2.1/servers/8c8318af-931d-4569-8264-7a5d1ded7553 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:57:35.353442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-619188f3-ad36-41b4-84e6-a3def32d1d16 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '.version_select at 0x7f9f3996b310>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:35.372435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-619188f3-ad36-41b4-84e6-a3def32d1d16 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134749664" status: 202 len: 0 microversion: 2.1 time: 0.022483 Sep 19 14:57:35.372994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 513/623] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Sep 19 14:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134749664 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:57:38.237370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:38.238182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:38.245663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:38.246156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:38.246591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:38.247298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:38.247751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:38.248204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:38.275848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:57:38.361006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1db40eca-0e35-4b2f-8b29-4d517e38b6a6 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 204 len: 0 microversion: 2.1 time: 0.127121 Sep 19 14:57:38.361606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 514/624] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:38 2022] DELETE /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:57:38.371354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:38.372092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:38.378437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:38.379527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:38.379997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:38.380721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:38.381186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:38.381666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:38.523734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:38.531452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7bb61d08-32ff-4d83-b383-749287a16cc1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1508 microversion: 2.1 time: 0.164773 Sep 19 14:57:38.532033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 515/625] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:38 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:39.031156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc2609ad-c7f9-4435-8a54-ff139bb9eb03"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:39.033546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:39.040207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.040679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.041117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.042195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.042682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.043114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.123230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Invalid volume: volume cc2609ad-c7f9-4435-8a54-ff139bb9eb03 is already attached to instances: cf690c71-c2d4-432f-b912-4d9b0918f3af Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: POST /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments HTTP/1.1 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 74 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:57:39.125041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {"volumeAttachment": {"volumeId": "cc2609ad-c7f9-4435-8a54-ff139bb9eb03"}} Sep 19 14:57:39.126596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Invalid volume: volume cc2609ad-c7f9-4435-8a54-ff139bb9eb03 is already attached to instances: cf690c71-c2d4-432f-b912-4d9b0918f3af Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'server_id': 'cf690c71-c2d4-432f-b912-4d9b0918f3af', 'body': {'volumeAttachment': {'volumeId': 'cc2609ad-c7f9-4435-8a54-ff139bb9eb03'}}} Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc2609ad-c7f9-4435-8a54-ff139bb9eb03 is already attached to instances: cf690c71-c2d4-432f-b912-4d9b0918f3af Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:39.127465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc2609ad-c7f9-4435-8a54-ff139bb9eb03 is already attached to instances: cf690c71-c2d4-432f-b912-4d9b0918f3af Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:39.128931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc2609ad-c7f9-4435-8a54-ff139bb9eb03 is already attached to instances: cf690c71-c2d4-432f-b912-4d9b0918f3af Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 400 to user: Invalid volume: volume cc2609ad-c7f9-4435-8a54-ff139bb9eb03 is already attached to instances: cf690c71-c2d4-432f-b912-4d9b0918f3af {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f93402c4-dbf5-44b7-a79b-02d0074632e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099512 Sep 19 14:57:39.130342 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 516/626] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:57:39 2022] POST /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:57:39.193063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:39.193598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:39.199583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.200089 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.200520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.201193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.201640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.202056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.286382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lazy-loading 'services' on Instance uuid cf690c71-c2d4-432f-b912-4d9b0918f3af {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:39.358579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a32cdca7-e423-4c93-923f-879c83f23a2d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments/cc2609ad-c7f9-4435-8a54-ff139bb9eb03" status: 202 len: 0 microversion: 2.1 time: 0.169200 Sep 19 14:57:39.359328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 517/627] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:57:39 2022] DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments/cc2609ad-c7f9-4435-8a54-ff139bb9eb03 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:57:39.368340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:39.370839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:39.377112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.377637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.378099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.378858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.379356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.379801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.410969 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a4079d39-beef-4b5b-9590-3935e67e71c6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Sep 19 14:57:39.411520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 518/628] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:57:39 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:39.554464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:39.554974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:39.561156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.561629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.562058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.562740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:39.563186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:39.563607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:39.694591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:39.702208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0e852ab2-9650-4f77-b42a-a8d65c4dd156 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1508 microversion: 2.1 time: 0.151818 Sep 19 14:57:39.702761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 519/629] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:39 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:40.542016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:40.544420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:40.552037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:40.552755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:40.553196 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:40.553912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:40.554371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:40.554799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:40.587915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1f6b16b9-d614-4ea6-bf5c-cb501d554ca1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168673 Sep 19 14:57:40.593981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 520/630] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:57:40 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:40.724842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:40.725519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:40.731629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:40.732176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:40.732616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:40.733345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:40.733982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:40.734421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:40.753222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:40.870157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:40.878336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0290e5c5-ca38-4968-a622-f549a3ba91d1 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1508 microversion: 2.1 time: 0.157577 Sep 19 14:57:40.879474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 521/631] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:40 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:41.464948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-2b0cc4c0-e29c-4e06-bda0-8859be418fd8 req-0a4bd871-b22b-42af-9446-6c1d8b83dc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8687a47-c664-4e00-961a-7e735ca2254c", "name": "network-vif-deleted", "tag": "c67e14ea-7899-4204-8e10-f7a30d3a861b"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:41.476574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2b0cc4c0-e29c-4e06-bda0-8859be418fd8 req-0a4bd871-b22b-42af-9446-6c1d8b83dc57 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.477307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2b0cc4c0-e29c-4e06-bda0-8859be418fd8 req-0a4bd871-b22b-42af-9446-6c1d8b83dc57 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.477739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2b0cc4c0-e29c-4e06-bda0-8859be418fd8 req-0a4bd871-b22b-42af-9446-6c1d8b83dc57 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.489603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2b0cc4c0-e29c-4e06-bda0-8859be418fd8 req-0a4bd871-b22b-42af-9446-6c1d8b83dc57 service nova] Creating event network-vif-deleted:c67e14ea-7899-4204-8e10-f7a30d3a861b for instance a8687a47-c664-4e00-961a-7e735ca2254c on hv-cinder-75670 Sep 19 14:57:41.494610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-2b0cc4c0-e29c-4e06-bda0-8859be418fd8 req-0a4bd871-b22b-42af-9446-6c1d8b83dc57 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Sep 19 14:57:41.495205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 522/632] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:41.601201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:41.604850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:41.612856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.613648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.614294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.615177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.615726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.616374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.649111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-00d64faf-0113-4eca-84a5-ac5a6c37f56d tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052318 Sep 19 14:57:41.649697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 523/633] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:57:41 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 14:57:41.725879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:41.726639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:41.733978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.734471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.735101 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.735606 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.736277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.736707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.767045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:57:41.851578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7c9c91b2-bbec-4f0f-89ab-901a1c6a1ae7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 204 len: 0 microversion: 2.1 time: 0.132278 Sep 19 14:57:41.852115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 524/634] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:41 2022] DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:57:41.860777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:41.861483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:41.868413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.868909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.869357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:41.870070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:41.870529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:41.870960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.003219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:42.010984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-31a516eb-b3e2-461a-a89b-25dd28073e00 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1679 microversion: 2.1 time: 0.154348 Sep 19 14:57:42.011549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 525/635] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:41 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:42.016165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:42.016770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:42.018612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:42.025876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:42.026591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:42.027248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.028352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:42.029044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:42.029707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.078141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:42.079024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:42.079660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:42.080171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'fault' on Instance uuid a8687a47-c664-4e00-961a-7e735ca2254c {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:42.134604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:42.142297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b9f9511f-c1d1-4106-ad11-02197163756e tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1311 microversion: 2.1 time: 0.129755 Sep 19 14:57:42.142880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 526/636] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:42 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:43.034600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:43.035932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:43.042447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:43.042930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:43.043474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:43.044114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:43.044550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:43.044983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:43.181158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:43.189162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bb326f98-824b-4802-9c36-5ae55e8094a4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1679 microversion: 2.1 time: 0.158480 Sep 19 14:57:43.189719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 527/637] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:43 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:43.196029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:43.196029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:43.201464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:43.202000 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:43.202444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:43.203145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:43.203607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:43.204119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:43.235985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:43.236470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:43.236911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:43.237358 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'fault' on Instance uuid a8687a47-c664-4e00-961a-7e735ca2254c {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:43.280739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:43.288823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e7f00cea-49e7-4b09-b19f-03e604ccd15f tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 200 len: 1311 microversion: 2.1 time: 0.098060 Sep 19 14:57:43.289442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 528/638] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:43 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:44.212765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:44.213542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:44.220249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.220739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.221180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.221889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.222842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.223269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.421670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:44.429830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e50bb337-9356-4e18-a53e-2ecb2bf6bc63 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1679 microversion: 2.1 time: 0.221302 Sep 19 14:57:44.430407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 529/639] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:44 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:44.436001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:44.436747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a8687a47-c664-4e00-961a-7e735ca2254c] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:44.443929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.444381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.444868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.445566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.446014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.446437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.460911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] HTTP exception thrown: Instance a8687a47-c664-4e00-961a-7e735ca2254c could not be found. Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Request method failure captured: Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c HTTP/1.1 Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIupeH_kuHISBrwHOUes8TECc-yxkq7b0k3DfsWggDcApN4As7X5NzdGOoPirf2u3aPbJvApSy3DvooofC8KEV4NI5rcW5jEkWYQIM7pZDnZpnJf_mRnNsu3-t8RbAU_CzK_dNp42W3_VdekEppHEJ5_n4Rv8cZMzkSm_fGMP7mlmU Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:57:44.462894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73c223bd20fc43eca4c1cd0921f7906d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 1cccf354894c4311b7710d8a65682eeb Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance a8687a47-c664-4e00-961a-7e735ca2254c could not be found. Sep 19 14:57:44.464569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'a8687a47-c664-4e00-961a-7e735ca2254c'} Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8687a47-c664-4e00-961a-7e735ca2254c could not be found. Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:44.465388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8687a47-c664-4e00-961a-7e735ca2254c could not be found. Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8687a47-c664-4e00-961a-7e735ca2254c could not be found. Sep 19 14:57:44.466569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:44.467891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Returning 404 to user: Instance a8687a47-c664-4e00-961a-7e735ca2254c could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:44.467891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-50134a53-3620-4869-9383-756cfb91a7d3 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c" status: 404 len: 111 microversion: 2.1 time: 0.032915 Sep 19 14:57:44.467891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 530/640] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:44 2022] GET /compute/v2.1/servers/a8687a47-c664-4e00-961a-7e735ca2254c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:57:44.475495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:44.475703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:44.482354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.482845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.483276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.484013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.484461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.485085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.513146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:57:44.596176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-28d681eb-32ad-44c6-a2b5-ed0e25720463 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 204 len: 0 microversion: 2.1 time: 0.126065 Sep 19 14:57:44.596739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 531/641] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:57:44 2022] DELETE /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:57:44.606579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:44.607290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:44.613524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.614024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.614470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.615209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.615668 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.616133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.842679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:44.851619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-08befade-b689-4451-b9f6-ace2202e78a9 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.249149 Sep 19 14:57:44.852294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 532/642] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:44 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:44.872738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-57a4ce1e-d63f-4a96-ac8c-c526463a5479 req-647550b9-1e2b-458b-9123-598c8e729fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf690c71-c2d4-432f-b912-4d9b0918f3af", "name": "network-vif-deleted", "tag": "88eb59a5-7768-48b5-bf92-78da65a37cc5"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:44.882928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-57a4ce1e-d63f-4a96-ac8c-c526463a5479 req-647550b9-1e2b-458b-9123-598c8e729fa9 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:44.883406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-57a4ce1e-d63f-4a96-ac8c-c526463a5479 req-647550b9-1e2b-458b-9123-598c8e729fa9 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:44.883866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-57a4ce1e-d63f-4a96-ac8c-c526463a5479 req-647550b9-1e2b-458b-9123-598c8e729fa9 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:44.896380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-57a4ce1e-d63f-4a96-ac8c-c526463a5479 req-647550b9-1e2b-458b-9123-598c8e729fa9 service nova] Creating event network-vif-deleted:88eb59a5-7768-48b5-bf92-78da65a37cc5 for instance cf690c71-c2d4-432f-b912-4d9b0918f3af on hv-cinder-75670 Sep 19 14:57:44.902233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-57a4ce1e-d63f-4a96-ac8c-c526463a5479 req-647550b9-1e2b-458b-9123-598c8e729fa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Sep 19 14:57:44.902839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 533/643] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:45.455939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:45.456698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:45.463776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:45.464289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:45.464715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:45.465413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:45.465860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:45.466277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:45.531990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:45.540512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a5f4319d-9950-4878-bcbe-619570d7b67c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1611 microversion: 2.1 time: 0.089089 Sep 19 14:57:45.541185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 534/644] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:45 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:45.877453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:45.877453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:45.884055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:45.884549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:45.885006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:45.885707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:45.886161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:45.886577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.012739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:46.021194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-472bcbc7-ea6e-45e9-bb40-fc6cea65d822 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.149960 Sep 19 14:57:46.024394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 535/645] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:45 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:46.565430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:46.566146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:46.573056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.573581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.574062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.574795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:46.575256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:46.575687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:46.579803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:46.643585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:46.651929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ec556030-7d2d-44d9-a311-91667e7d30eb tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1611 microversion: 2.1 time: 0.090413 Sep 19 14:57:46.652494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 536/646] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:46 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:47.048183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:47.048799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:47.055029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:47.055516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:47.055992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:47.056726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:47.057528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:47.058017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:47.187800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:47.196300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ea050815-28dd-42a3-ac4a-6ab87e3700e7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.152325 Sep 19 14:57:47.196870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 537/647] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:47 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:47.676097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:47.676775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:47.683307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:47.683787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:47.684242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:47.684924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:47.685375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:47.685797 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:47.747610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:47.755808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-30432990-5d00-4390-8dd2-f07911add068 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 200 len: 1611 microversion: 2.1 time: 0.083808 Sep 19 14:57:47.756394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 538/648] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:47 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 1611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:48.220440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:48.221066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:48.227138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:48.227691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:48.228208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:48.229029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:48.229528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:48.230049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:48.366970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:48.374733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6b1cba06-9eca-48f7-9b90-bc6b8eb14b75 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1523 microversion: 2.1 time: 0.158334 Sep 19 14:57:48.375268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 539/649] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:48 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:48.779161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:48.780127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:48.787162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:48.787741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:48.788288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:48.789084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:48.789724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:48.790154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:48.806644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af HTTP/1.1 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:57:48.808635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:57:48.810319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'cf690c71-c2d4-432f-b912-4d9b0918f3af'} Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:48.811378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:57:48.812844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:48.814615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:48.814615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7c8296c5-4aca-4f3d-bfc8-8f4ba06b7e6c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 404 len: 111 microversion: 2.1 time: 0.035314 Sep 19 14:57:48.814615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 540/650] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:48 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:57:48.821448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-936fc4b2-b2e6-4dd7-8d24-916888d0e012 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '.version_select at 0x7f9f399a7e50>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:48.843352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-936fc4b2-b2e6-4dd7-8d24-916888d0e012 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309030038" status: 202 len: 0 microversion: 2.1 time: 0.026955 Sep 19 14:57:48.844073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 541/651] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Sep 19 14:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309030038 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:57:49.123363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-adebf36e-ad62-475f-b4fd-f54fc9fb60e9 req-7e006412-63cd-48ec-9bea-4b9a1450daa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c3dc74-07a1-4032-88cd-fae46c1e9f70", "name": "network-vif-deleted", "tag": "b9e6540e-5c0b-4fdb-8f91-a01a88c01a3d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:49.135255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-adebf36e-ad62-475f-b4fd-f54fc9fb60e9 req-7e006412-63cd-48ec-9bea-4b9a1450daa0 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:49.135721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-adebf36e-ad62-475f-b4fd-f54fc9fb60e9 req-7e006412-63cd-48ec-9bea-4b9a1450daa0 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:49.136219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-adebf36e-ad62-475f-b4fd-f54fc9fb60e9 req-7e006412-63cd-48ec-9bea-4b9a1450daa0 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:49.150278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-adebf36e-ad62-475f-b4fd-f54fc9fb60e9 req-7e006412-63cd-48ec-9bea-4b9a1450daa0 service nova] Creating event network-vif-deleted:b9e6540e-5c0b-4fdb-8f91-a01a88c01a3d for instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 on hv-cinder-75670 Sep 19 14:57:49.155500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-adebf36e-ad62-475f-b4fd-f54fc9fb60e9 req-7e006412-63cd-48ec-9bea-4b9a1450daa0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035774 Sep 19 14:57:49.156160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 542/652] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:49.400665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:49.401960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:49.410735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:49.412078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:49.412745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:49.414548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:49.415241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:49.416795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:49.457623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:49.458115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:49.458556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:49.459015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lazy-loading 'fault' on Instance uuid a0c3dc74-07a1-4032-88cd-fae46c1e9f70 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:49.755264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cccf354894c4311b7710d8a65682eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c223bd20fc43eca4c1cd0921f7906d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:49.764302 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-681fb09c-bdda-45e6-a015-687b549da2a7 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 200 len: 1312 microversion: 2.1 time: 0.368388 Sep 19 14:57:49.765044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 543/653] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:49 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:49.798863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-578e8c47-3729-4444-bbfc-30b69180f60e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: .version_select at 0x7f9f399a7820>, body: {"keypair": {"name": "tempest-keypair-721797173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7QOaJaYn9PXzGw9k4vQtOLJJxDL6EJOhTvBg2+4SJ6SvpzPBsvAni22Y0LvKfXohe+qHhnrfK50VeCuuhHiqMVbLSlAFWdHhJzVZ7RQL8fCjH4UnNK7hyVKmHzu/9/Qg=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:49.816385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-578e8c47-3729-4444-bbfc-30b69180f60e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:49.820525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-578e8c47-3729-4444-bbfc-30b69180f60e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:49.847986 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-578e8c47-3729-4444-bbfc-30b69180f60e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052165 Sep 19 14:57:49.848597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 544/654] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:57:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:50.788928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:50.789551 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] [instance: a0c3dc74-07a1-4032-88cd-fae46c1e9f70] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:50.796054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:50.796545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:50.796987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.797690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:50.798147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:50.798577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:50.814087 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] HTTP exception thrown: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 could not be found. Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Request method failure captured: Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 HTTP/1.1 Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIupeH_kuHISBrwHOUes8TECc-yxkq7b0k3DfsWggDcApN4As7X5NzdGOoPirf2u3aPbJvApSy3DvooofC8KEV4NI5rcW5jEkWYQIM7pZDnZpnJf_mRnNsu3-t8RbAU_CzK_dNp42W3_VdekEppHEJ5_n4Rv8cZMzkSm_fGMP7mlmU Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:57:50.816424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_73c223bd20fc43eca4c1cd0921f7906d", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/73c223bd20fc43eca4c1cd0921f7906d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 73c223bd20fc43eca4c1cd0921f7906d Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-238248653 Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 1cccf354894c4311b7710d8a65682eeb Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-238248653-project Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 could not be found. Sep 19 14:57:50.817931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'a0c3dc74-07a1-4032-88cd-fae46c1e9f70'} Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 could not be found. Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:57:50.818705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 could not be found. Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 could not be found. Sep 19 14:57:50.820170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:57:50.821459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] Returning 404 to user: Instance a0c3dc74-07a1-4032-88cd-fae46c1e9f70 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:57:50.821459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-da084a8a-2d84-48e2-87d1-914b64f71911 tempest-ServerRescueNegativeTestJSON-238248653 tempest-ServerRescueNegativeTestJSON-238248653-project] 10.222.0.60 "GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70" status: 404 len: 111 microversion: 2.1 time: 0.033660 Sep 19 14:57:50.821459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 545/655] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:50 2022] GET /compute/v2.1/servers/a0c3dc74-07a1-4032-88cd-fae46c1e9f70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:57:51.094334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-35707347", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be7d8aa6-9b4b-4d6b-91e8-89101b447c76"}], "security_groups": [{"name": "tempest-securitygroup--1350529416"}], "key_name": "tempest-keypair-721797173", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:51.236208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] validate_networks() for [('be7d8aa6-9b4b-4d6b-91e8-89101b447c76', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:57:51.956412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:57:51.957018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:57:51.957296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:57:51.957709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:57:51.958124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:57:51.967229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:51.967716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:51.968189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:51.969044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:51.969575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:51.970037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:51.986825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:57:51.991435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Getting quotas for user 61743a63def7451d9b739f3b17afe8b8 and project b89056beeba940128ec6ff72b0c55b34. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:57:52.002651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:57:52.005625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:57:52.055012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3b809efb-11ad-4c38-8be8-95cfd3b296c9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.965156 Sep 19 14:57:52.055670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 546/656] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:57:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:57:52.216663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:52.217325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:52.237425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.256105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.257023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.258171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:52.259046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:52.259710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:52.294914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-040e8bb4-9433-4643-97bc-03a74e34a280 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/ips" status: 200 len: 152 microversion: 2.20 time: 0.238150 Sep 19 14:57:52.295871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 547/657] 10.222.0.60 () {60 vars in 1289 bytes} [Mon Sep 19 14:57:52 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/ips => generated 152 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:57:52.303510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-65615434-e7b1-4dc9-a1f3-a31ef26f0922 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:52.304466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-65615434-e7b1-4dc9-a1f3-a31ef26f0922 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:52.386604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-65615434-e7b1-4dc9-a1f3-a31ef26f0922 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:52.402355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-65615434-e7b1-4dc9-a1f3-a31ef26f0922 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1239 microversion: 2.1 time: 0.104349 Sep 19 14:57:52.404691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 548/658] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:52 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:53.427709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:53.428734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:53.436183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.436680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.437122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.437833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:53.438289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:53.438774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:53.862120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:53.871374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f9826f8f-1d05-4453-b203-b567c863c8a1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1299 microversion: 2.1 time: 0.448248 Sep 19 14:57:53.872220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 549/659] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:53 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1299 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:54.329381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:54.330314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.340890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.341272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.341949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.342685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.343016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.343436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.367991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lazy-loading 'flavor' on Instance uuid 415dd25c-7c9f-4db5-b8ea-fac7016eda48 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:57:54.678582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e7b2c96d-09b1-49a4-b225-a2b32b4bdf43 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/action" status: 202 len: 0 microversion: 2.20 time: 0.353451 Sep 19 14:57:54.680183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 550/660] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Sep 19 14:57:54 2022] POST /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:57:54.689024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:54.690044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:54.698230 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.699107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.699891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:54.701304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:54.702223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:54.703572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:55.004060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:55.028353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:55.032944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:55.042336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6bfd93df-f57f-4984-8aa7-4f59c1eba084 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.357518 Sep 19 14:57:55.051891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 551/661] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:54 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:55.056881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:55.057740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:55.091085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:55.091612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:55.092071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:55.092786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:55.093242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:55.093665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:55.425730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:55.434435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a0ab58a3-1721-44eb-bbc4-84906d5fe4b0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.381254 Sep 19 14:57:55.436098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 552/662] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:55 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:55.924550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-2d4a8192-777e-423e-bc32-1be7058c6505 req-4b0d1709-eb5b-42a2-a35f-fdaee2e5da5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243344cf-34e7-491b-8cd6-33923aeff28e", "tag": "d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:55.938717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2d4a8192-777e-423e-bc32-1be7058c6505 req-4b0d1709-eb5b-42a2-a35f-fdaee2e5da5a service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:55.939247 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2d4a8192-777e-423e-bc32-1be7058c6505 req-4b0d1709-eb5b-42a2-a35f-fdaee2e5da5a service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:55.939881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2d4a8192-777e-423e-bc32-1be7058c6505 req-4b0d1709-eb5b-42a2-a35f-fdaee2e5da5a service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:55.955158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2d4a8192-777e-423e-bc32-1be7058c6505 req-4b0d1709-eb5b-42a2-a35f-fdaee2e5da5a service nova] Creating event network-changed:d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b for instance 243344cf-34e7-491b-8cd6-33923aeff28e on hv-cinder-75670 Sep 19 14:57:55.960585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-2d4a8192-777e-423e-bc32-1be7058c6505 req-4b0d1709-eb5b-42a2-a35f-fdaee2e5da5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039880 Sep 19 14:57:55.961187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 553/663] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:56.072422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:56.073152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:56.079859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:56.080676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:56.082064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.082794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:56.083257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:56.083685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.291651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:56.301355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:56.302805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:56.304004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7bc2df24-edb7-4e86-90b3-a5c35844ac61 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.236150 Sep 19 14:57:56.304567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 554/664] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:56 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:56.422205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4d67a6ea-1b54-4262-b0ee-af3bdc7e7402 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Action: 'create', calling method: .version_select at 0x7f9f3997b940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1543266730"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:56.720686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4d67a6ea-1b54-4262-b0ee-af3bdc7e7402 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.415013 Sep 19 14:57:56.721344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 555/665] 10.222.0.60 () {60 vars in 1155 bytes} [Mon Sep 19 14:57:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 14:57:56.726460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:56.727072 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:56.729461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:56.736468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:56.736970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:56.737424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.737979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:56.738470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:56.738864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:56.868041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:56.875723 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f2496f18-827e-444f-b1c5-73c21bf21d94 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.153455 Sep 19 14:57:56.876684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 556/666] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:56 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:57:56.881991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4f5ebd94-ca62-41c4-a5d0-13e021aa8488 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3997bdc0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:56.929352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4f5ebd94-ca62-41c4-a5d0-13e021aa8488 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 200 len: 345 microversion: 2.1 time: 0.051468 Sep 19 14:57:56.930070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 557/667] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:57:56 2022] GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:57.330770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:57.332168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:57.338740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:57.339477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:57.339881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:57.340574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:57.341027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:57.341485 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:57.555096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:57.564078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:57.566110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:57.567310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d6533e43-834e-4066-9c7a-f366d3cb7ddb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.240977 Sep 19 14:57:57.567876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 558/668] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:57 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:57.900161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:57.900784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:57.906732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:57.907220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:57.907662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:57.908391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:57.908850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:57.909311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:57.914059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:57:58.042370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:58.050075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b104f4f2-4bd4-421a-a21f-187d9e342fb7 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.154558 Sep 19 14:57:58.050634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 559/669] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:57 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:58.055035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-37f3a87d-5055-4a71-944b-a06de89f5e4d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3994b820>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:58.102316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-37f3a87d-5055-4a71-944b-a06de89f5e4d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 200 len: 346 microversion: 2.1 time: 0.050634 Sep 19 14:57:58.102883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 560/670] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:57:58 2022] GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:58.115663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad04111f-18ae-4b19-82f2-8cc72e57427a tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Action: 'create', calling method: .version_select at 0x7f9f3a6e1d30>, body: {"snapshot": {"volume_id": "2f3720fa-df4a-4920-a09b-b2fd8072c4a1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2114460109"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:57:58.268559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ad04111f-18ae-4b19-82f2-8cc72e57427a tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.156519 Sep 19 14:57:58.269792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 561/671] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Sep 19 14:57:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:58.282142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a855e2f6-7e03-40b9-907c-fb49fdbf7e8c tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3991ef70>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:58.316383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a855e2f6-7e03-40b9-907c-fb49fdbf7e8c tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 200 len: 287 microversion: 2.1 time: 0.037800 Sep 19 14:57:58.317013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 562/672] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:57:58 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:58.328730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9ceb1645-a42d-47be-9475-269809231fac tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3997b280>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:58.361318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9ceb1645-a42d-47be-9475-269809231fac tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036309 Sep 19 14:57:58.361896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 563/673] 10.222.0.60 () {58 vars in 1140 bytes} [Mon Sep 19 14:57:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:57:58.373058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2c0d716b-65d2-4712-a46b-62f0db6f5286 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3994dd30>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:58.404998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2c0d716b-65d2-4712-a46b-62f0db6f5286 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 200 len: 287 microversion: 2.1 time: 0.035728 Sep 19 14:57:58.405671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 564/674] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:57:58 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:58.593328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:58.593940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:58.602348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:58.602839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:58.603282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:58.604077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:58.604544 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:58.604970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:58.731798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:58.740787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:58.742314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:58.743586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d27a95f0-bd0f-45bc-8df5-93893ec88a7d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.154282 Sep 19 14:57:58.744185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 565/675] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:58 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:57:59.073145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:59.073801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:59.080090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.080574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.081066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.081709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.082170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.082595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.215274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:59.223532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d9dcd586-83bc-47fa-ba70-1f843f8f7598 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.154557 Sep 19 14:57:59.224127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 566/676] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:57:59 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:57:59.418141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-13a53b48-c1df-47a9-9bf3-9f6f90a0374a tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f39945550>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:59.449791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-13a53b48-c1df-47a9-9bf3-9f6f90a0374a tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 200 len: 287 microversion: 2.1 time: 0.035532 Sep 19 14:57:59.450373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 567/677] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:57:59 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:57:59.771761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:57:59.772308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:57:59.779090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.779579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.780235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.781039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:57:59.781631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:57:59.782090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:57:59.912050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:59.920206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:59.921656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:57:59.922814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-34224697-97f9-4322-b268-a740b0c07417 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.155414 Sep 19 14:57:59.923370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 568/678] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:57:59 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:00.246684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:00.247362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:00.253298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:00.253786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:00.254232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:00.254924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:00.255387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:00.255812 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:00.386399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:00.394612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-65fc2de7-73cc-440c-b7ec-48187543ae8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.151965 Sep 19 14:58:00.395176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 569/679] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:00 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:00.463121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1684e350-1adb-497b-8a68-1694224f99fc tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3998d790>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:00.492933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1684e350-1adb-497b-8a68-1694224f99fc tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 200 len: 287 microversion: 2.1 time: 0.033571 Sep 19 14:58:00.493483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 570/680] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:58:00 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:00.949607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:00.950214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:00.956329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:00.956816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:00.957251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:00.957938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:00.958393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:00.958815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:01.086488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.095215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.097359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.098526 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0fe820e2-7052-4f88-b5d4-2b5f5108f3b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.152961 Sep 19 14:58:01.099080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 571/681] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:00 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:01.418147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:01.418791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:01.424894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:01.425372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:01.425798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:01.426485 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:01.426927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:01.427369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:01.561270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:01.569905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6660e52d-5d7c-480d-b21f-f26bf44fd6d0 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.155742 Sep 19 14:58:01.570494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 572/682] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:01 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:01.574959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a1c3c2b0-50ae-4af8-bfd3-7ed67a3040de tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f39b15c10>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:01.605565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a1c3c2b0-50ae-4af8-bfd3-7ed67a3040de tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 200 len: 288 microversion: 2.1 time: 0.034005 Sep 19 14:58:01.606112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 573/683] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:58:01 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:01.618249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c2fcc667-aeb6-4855-b094-db803b3ba82d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f39965f70>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:01.676080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c2fcc667-aeb6-4855-b094-db803b3ba82d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 202 len: 0 microversion: 2.1 time: 0.061442 Sep 19 14:58:01.676689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 574/684] 10.222.0.60 () {58 vars in 1254 bytes} [Mon Sep 19 14:58:01 2022] DELETE /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:58:01.685481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-83d9174b-b898-42d7-a8e8-b1a8aa4de004 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3998d040>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:01.715557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-83d9174b-b898-42d7-a8e8-b1a8aa4de004 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 200 len: 287 microversion: 2.1 time: 0.034086 Sep 19 14:58:01.716167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 575/685] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:58:01 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:02.121062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:02.125156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.125775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.132747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.133236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.133679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.134373 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.134833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.135264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.266593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:02.275331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:02.277006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:02.278200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-789640e8-c72f-461b-96bc-c4d000112ef1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.157902 Sep 19 14:58:02.278755 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 576/686] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:02.593280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.593953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:02.595659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=12 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:02.601351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.601834 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.602279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.602972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:02.603427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:02.603884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:02.735981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:02.744201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3ddcd389-2251-471c-ade9-98275c533629 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.154913 Sep 19 14:58:02.744766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 577/687] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:02.749214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b6f2f9b0-52ca-4ae6-871d-c444db3b0c9d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f399298b0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.774890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-b6f2f9b0-52ca-4ae6-871d-c444db3b0c9d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] HTTP exception thrown: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b6f2f9b0-52ca-4ae6-871d-c444db3b0c9d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Request method failure captured: Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 HTTP/1.1 Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIN0uAuvQKwlEsGOYKjQ3PHxxhd-guYGoc9FZO1vqRInamMprbIVBaPro39Q4JRKaVhcdQNmXjaCgpPpo8j1OhLOJsAWJjXhxlkjTViKuQ8ji6__VDCYIpvqNK-8cEfkyZ_tdJtZvHoK070rFlZB9xnlm9Svnp4S1-tGfYnsOMM-_1c Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:02.777291 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db382ca794b542e7a00b15ce60ae12e0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: d5a2824f8161498fad8c6312a5112f5b Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '76a572b8-cd85-4cc7-b038-fd2294783ff9'} Sep 19 14:58:02.778871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. (HTTP 404) (Request-ID: req-feab3bf3-8aa4-46ef-b8a6-a47a13537e2d) Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.780048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:58:02.781370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 14:58:02.783170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b6f2f9b0-52ca-4ae6-871d-c444db3b0c9d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Returning 404 to user: Snapshot 76a572b8-cd85-4cc7-b038-fd2294783ff9 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:02.784842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b6f2f9b0-52ca-4ae6-871d-c444db3b0c9d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9" status: 404 len: 111 microversion: 2.1 time: 0.032977 Sep 19 14:58:02.785811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 578/688] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/os-snapshots/76a572b8-cd85-4cc7-b038-fd2294783ff9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:02.787184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8a869553-5928-418e-b0e9-3cfb83ddfc7e tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3994d550>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.850878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8a869553-5928-418e-b0e9-3cfb83ddfc7e tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 202 len: 0 microversion: 2.1 time: 0.067016 Sep 19 14:58:02.851881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 579/689] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:58:02 2022] DELETE /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:58:02.860066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dabf03ac-12d8-4904-a668-25b0e9e29398 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f39ce6d30>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:02.913537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dabf03ac-12d8-4904-a668-25b0e9e29398 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 200 len: 345 microversion: 2.1 time: 0.057235 Sep 19 14:58:02.914108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 580/690] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:58:02 2022] GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:03.244493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-bc25be05-1572-460f-bf94-672f095f8da7 req-15989b3b-278d-4909-870f-95895fc51615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243344cf-34e7-491b-8cd6-33923aeff28e", "name": "network-vif-plugged", "status": "completed", "tag": "d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:03.255600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-bc25be05-1572-460f-bf94-672f095f8da7 req-15989b3b-278d-4909-870f-95895fc51615 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.256116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-bc25be05-1572-460f-bf94-672f095f8da7 req-15989b3b-278d-4909-870f-95895fc51615 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.256569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-bc25be05-1572-460f-bf94-672f095f8da7 req-15989b3b-278d-4909-870f-95895fc51615 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.267692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-bc25be05-1572-460f-bf94-672f095f8da7 req-15989b3b-278d-4909-870f-95895fc51615 service nova] Creating event network-vif-plugged:d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b for instance 243344cf-34e7-491b-8cd6-33923aeff28e on hv-cinder-75670 Sep 19 14:58:03.272801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-bc25be05-1572-460f-bf94-672f095f8da7 req-15989b3b-278d-4909-870f-95895fc51615 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032165 Sep 19 14:58:03.273434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 581/691] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:03.307508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:03.308595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:03.317893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.319193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.319658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.320770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.321228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.321655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.506091 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:03.514240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:03.515719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:03.516901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-90117425-2c5c-45c8-98cb-5d0abaec901f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.216154 Sep 19 14:58:03.517454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 582/692] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:03 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:03.767528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:03.768191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:03.775103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.775589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.776050 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.776735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:03.777179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:03.777785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:03.911892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:03.919635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a6db9766-f4ef-4ba9-9fb7-5a0a38dd1455 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.156099 Sep 19 14:58:03.920253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 583/693] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:03 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:03.928679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7710e947-c662-417f-90c6-b6ff64f8d966 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f39a883a0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:03.961274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-7710e947-c662-417f-90c6-b6ff64f8d966 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] HTTP exception thrown: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7710e947-c662-417f-90c6-b6ff64f8d966 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Request method failure captured: Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 HTTP/1.1 Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIN0uAuvQKwlEsGOYKjQ3PHxxhd-guYGoc9FZO1vqRInamMprbIVBaPro39Q4JRKaVhcdQNmXjaCgpPpo8j1OhLOJsAWJjXhxlkjTViKuQ8ji6__VDCYIpvqNK-8cEfkyZ_tdJtZvHoK070rFlZB9xnlm9Svnp4S1-tGfYnsOMM-_1c Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:03.963455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db382ca794b542e7a00b15ce60ae12e0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: d5a2824f8161498fad8c6312a5112f5b Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '2f3720fa-df4a-4920-a09b-b2fd8072c4a1'} Sep 19 14:58:03.965032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. (HTTP 404) (Request-ID: req-b6f0843d-30fb-465a-86a9-d19fb7039a7f) Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:03.965976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:58:03.967534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 14:58:03.969185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7710e947-c662-417f-90c6-b6ff64f8d966 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Returning 404 to user: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7710e947-c662-417f-90c6-b6ff64f8d966 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 404 len: 109 microversion: 2.1 time: 0.039881 Sep 19 14:58:03.970805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 584/694] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:58:03 2022] GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:58:03.979308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5bb3221f-04e6-449a-b73a-6f02d074c4e2 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3998d820>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:04.006914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-5bb3221f-04e6-449a-b73a-6f02d074c4e2 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] HTTP exception thrown: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5bb3221f-04e6-449a-b73a-6f02d074c4e2 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Request method failure captured: Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 HTTP/1.1 Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIN0uAuvQKwlEsGOYKjQ3PHxxhd-guYGoc9FZO1vqRInamMprbIVBaPro39Q4JRKaVhcdQNmXjaCgpPpo8j1OhLOJsAWJjXhxlkjTViKuQ8ji6__VDCYIpvqNK-8cEfkyZ_tdJtZvHoK070rFlZB9xnlm9Svnp4S1-tGfYnsOMM-_1c Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:04.009024 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db382ca794b542e7a00b15ce60ae12e0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: d5a2824f8161498fad8c6312a5112f5b Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '2f3720fa-df4a-4920-a09b-b2fd8072c4a1'} Sep 19 14:58:04.010584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. (HTTP 404) (Request-ID: req-be303165-d6d2-4a12-b08a-3ecf983f3cb2) Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:04.011670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:58:04.012908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 14:58:04.014404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5bb3221f-04e6-449a-b73a-6f02d074c4e2 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Returning 404 to user: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5bb3221f-04e6-449a-b73a-6f02d074c4e2 tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 404 len: 109 microversion: 2.1 time: 0.034773 Sep 19 14:58:04.016059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 585/695] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:58:03 2022] DELETE /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:58:04.019175 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-caa6ba07-ad79-4b30-9918-34e1eecd032d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Calling method '.version_select at 0x7f9f3998d040>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:04.048982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-caa6ba07-ad79-4b30-9918-34e1eecd032d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] HTTP exception thrown: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-caa6ba07-ad79-4b30-9918-34e1eecd032d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Request method failure captured: Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 HTTP/1.1 Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIN0uAuvQKwlEsGOYKjQ3PHxxhd-guYGoc9FZO1vqRInamMprbIVBaPro39Q4JRKaVhcdQNmXjaCgpPpo8j1OhLOJsAWJjXhxlkjTViKuQ8ji6__VDCYIpvqNK-8cEfkyZ_tdJtZvHoK070rFlZB9xnlm9Svnp4S1-tGfYnsOMM-_1c Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:04.050937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db382ca794b542e7a00b15ce60ae12e0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db382ca794b542e7a00b15ce60ae12e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db382ca794b542e7a00b15ce60ae12e0 Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1714074504 Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: d5a2824f8161498fad8c6312a5112f5b Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1714074504-project Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '2f3720fa-df4a-4920-a09b-b2fd8072c4a1'} Sep 19 14:58:04.052304 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. (HTTP 404) (Request-ID: req-bb709f56-c81c-4524-b5c0-da2fc1873040) Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:04.053194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:58:04.054423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 14:58:04.055853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-caa6ba07-ad79-4b30-9918-34e1eecd032d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] Returning 404 to user: Volume 2f3720fa-df4a-4920-a09b-b2fd8072c4a1 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-caa6ba07-ad79-4b30-9918-34e1eecd032d tempest-VolumesSnapshotsTestJSON-1714074504 tempest-VolumesSnapshotsTestJSON-1714074504-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1" status: 404 len: 109 microversion: 2.1 time: 0.037575 Sep 19 14:58:04.057562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 586/696] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:58:04 2022] GET /compute/v2.1/os-volumes/2f3720fa-df4a-4920-a09b-b2fd8072c4a1 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:04.543718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:04.544351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:04.563930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:04.564413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:04.564856 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:04.565574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:04.566033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:04.566463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:04.734427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.743515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.745053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:04.746336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e1e0c62d-c6f4-4df2-8161-3e208bcb3364 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.207589 Sep 19 14:58:04.746924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 587/697] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:04 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:04.944809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:04.945454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:04.952186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:04.952751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:04.953364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:04.954140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:04.954679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:04.955163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:05.103488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:05.111321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-70b84d46-92f0-45f6-a1fb-9ef75c7e172e tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1365 microversion: 2.1 time: 0.171057 Sep 19 14:58:05.111908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 588/698] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:04 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:05.772021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:05.772877 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:05.778837 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:05.779314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:05.779785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:05.780498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:05.780944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:05.781475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:05.918073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:05.926989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:05.928517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:05.929878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c08906d6-c1ab-429d-956d-5a3a330d9474 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.162389 Sep 19 14:58:05.930439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 589/699] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:05 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:06.135315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:06.135951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:06.142779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.143267 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.143771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.144404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.144864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.145264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.285609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:06.293619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-57d62231-57e1-46ad-aadb-d1d76cdead8b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1555 microversion: 2.1 time: 0.162296 Sep 19 14:58:06.294294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 590/700] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:06 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:06.318398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:06.319043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:06.325424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.325941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.326498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.327204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.327633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.328081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.407805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-16fa7e0c-b9a1-4ade-8f8f-97439f5c7717 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094615 Sep 19 14:58:06.408463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 591/701] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:58:06 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:06.957923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:06.958043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:06.965026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.965588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.966032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:06.966741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:06.967197 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:06.967626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:07.494525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:07.498339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:07.505443 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:07.507385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:07.508779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-819184a6-7b4b-4524-b3f9-72e97c6e1d5f tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.555447 Sep 19 14:58:07.509334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 592/702] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:06 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:08.039593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-054fd07f-d468-4fca-aee5-a9cb73a33b16 req-31001275-97dc-48a8-aca4-f539500db062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243344cf-34e7-491b-8cd6-33923aeff28e", "tag": "d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:08.050782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-054fd07f-d468-4fca-aee5-a9cb73a33b16 req-31001275-97dc-48a8-aca4-f539500db062 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:08.051533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-054fd07f-d468-4fca-aee5-a9cb73a33b16 req-31001275-97dc-48a8-aca4-f539500db062 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:08.051995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-054fd07f-d468-4fca-aee5-a9cb73a33b16 req-31001275-97dc-48a8-aca4-f539500db062 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:08.065624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-054fd07f-d468-4fca-aee5-a9cb73a33b16 req-31001275-97dc-48a8-aca4-f539500db062 service nova] Creating event network-changed:d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b for instance 243344cf-34e7-491b-8cd6-33923aeff28e on hv-cinder-75670 Sep 19 14:58:08.070785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-054fd07f-d468-4fca-aee5-a9cb73a33b16 req-31001275-97dc-48a8-aca4-f539500db062 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258073 Sep 19 14:58:08.071518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 593/703] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:08.537289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:08.537984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:08.545118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:08.545865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:08.547238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:08.548025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:08.548661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:08.549254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:08.775662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:08.788785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:08.790252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:08.792114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-69513d80-662d-4eb0-bbed-d8b5eb3f9596 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.259717 Sep 19 14:58:08.792853 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 594/704] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:08 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:09.822423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:09.823026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:09.829939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:09.830422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:09.830992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:09.831692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:09.832163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:09.832585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:09.970497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:09.979215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:09.980833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:09.982095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a3bea8af-0374-470d-9793-05353dfd5a0d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.163571 Sep 19 14:58:09.982747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 595/705] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:09 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:11.007511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:11.008204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:11.014532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:11.015011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:11.015442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:11.016260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:11.016708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:11.017127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:11.152571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:11.161347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:11.162866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:11.164057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f94c7e05-4193-489b-990f-6d1fb8db49ed tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1744 microversion: 2.20 time: 0.160573 Sep 19 14:58:11.164615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 596/706] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:11 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:12.190450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:12.191159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:12.197741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:12.198227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:12.198667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:12.199370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:12.199903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:12.200457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:12.333053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:12.341492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:12.342896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:12.344096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-515fac4b-5b4d-43fb-aff4-136e4a240d57 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1744 microversion: 2.20 time: 0.157594 Sep 19 14:58:12.344659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 597/707] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:12 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:13.372040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:13.373733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:13.391493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:13.392381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:13.392984 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:13.395222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:13.395857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:13.396433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:13.616141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:13.630136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:13.632272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:13.634059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-032f71aa-0c2d-4cfe-811e-1fdb10570ae3 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.267617 Sep 19 14:58:13.635218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 598/708] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:13 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:14.666698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:14.667985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:14.683696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.687653 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.688472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.689407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:14.690931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:14.691520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:14.946623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.960336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.961995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:14.963649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-518d3871-bbd9-46bc-8d8b-31d61b5f9d59 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.306769 Sep 19 14:58:14.964401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 599/709] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:14 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:14.985673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:14.991669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:15.004274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.004680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.005464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.006179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.006636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.007028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.048286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-286ad230-11b8-4bd4-9a54-ab69d05b749f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065369 Sep 19 14:58:15.050492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 600/710] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:58:14 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:58:15.150936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:15.151795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:15.162657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.163422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.164054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.164937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.165576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.166163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.205892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:58:15.353030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-907afb2e-e531-4921-9d0e-afe4cd772096 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 204 len: 0 microversion: 2.1 time: 0.204336 Sep 19 14:58:15.354783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 601/711] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:58:15 2022] DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:58:15.649452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-212eb328-ced1-49aa-bc55-5c307c9434be req-4f214704-df86-46ce-b798-59a1daafceb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "name": "network-vif-plugged", "status": "completed", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:15.678209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-212eb328-ced1-49aa-bc55-5c307c9434be req-4f214704-df86-46ce-b798-59a1daafceb8 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.678897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-212eb328-ced1-49aa-bc55-5c307c9434be req-4f214704-df86-46ce-b798-59a1daafceb8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.679143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-212eb328-ced1-49aa-bc55-5c307c9434be req-4f214704-df86-46ce-b798-59a1daafceb8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.694156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-212eb328-ced1-49aa-bc55-5c307c9434be req-4f214704-df86-46ce-b798-59a1daafceb8 service nova] Creating event network-vif-plugged:274e690b-1c6b-4790-9dc2-5dbe545e77ae for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 on hv-cinder-75670 Sep 19 14:58:15.700422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-212eb328-ced1-49aa-bc55-5c307c9434be req-4f214704-df86-46ce-b798-59a1daafceb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339679 Sep 19 14:58:15.701042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 602/712] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:15.707365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:15.708372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:15.716458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.717187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.717634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.718533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:15.719022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:15.719539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:15.945937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:15.954003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-94d54314-7ee2-481b-8d71-d875f0cb0e02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1673 microversion: 2.1 time: 0.251672 Sep 19 14:58:15.956779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 603/713] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:15 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:15.999409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:16.000371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:16.008738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.010213 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.010864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.011778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.012475 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.013270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.183962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:16.198069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:16.199732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:16.201185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ec04c53a-1296-4a7b-a71c-c3fb2cd820f8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.205720 Sep 19 14:58:16.202147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 604/714] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:15 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:16.979691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:16.980483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:16.992177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.992789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.993292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:16.994464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:16.995274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:16.996249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:17.200163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:17.216866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-495075eb-5724-4e1b-9d73-30672298b298 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1673 microversion: 2.1 time: 0.240952 Sep 19 14:58:17.220537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 605/715] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:16 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1673 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:17.228204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:17.228811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:17.236262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:17.237496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:17.237941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:17.238841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:17.239303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:17.240153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:17.420154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:17.429921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:17.431137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:17.432603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-78b16023-3634-4a18-9417-a8f900133972 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.208169 Sep 19 14:58:17.443862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 606/716] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:17 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:18.243490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:18.246535 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:18.259652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.260738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.261602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.262641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.263546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.264250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.398740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.435540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1d8a2906-f442-4dbf-a7be-48aad4728933 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1606 microversion: 2.1 time: 0.194320 Sep 19 14:58:18.439619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 607/717] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:18 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1606 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:18.465245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:18.466208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:18.474546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.475049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.475491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.476238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.476702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.477145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.855887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.873075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.875159 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:18.880350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3126ed5c-67fe-485e-a4ad-8a68ce40564e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.419192 Sep 19 14:58:18.881629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 608/718] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:18 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:18.886859 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-17c10dcd-6ff4-4ff9-a409-eac435f0edd0 req-9e859964-1a0f-4346-ae1a-c2690125e216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41656a6-4409-4e9a-9b29-066443ea6426", "name": "network-vif-deleted", "tag": "0dd476b1-5ace-4b09-be4d-ba06ef204d1e"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:18.897424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-17c10dcd-6ff4-4ff9-a409-eac435f0edd0 req-9e859964-1a0f-4346-ae1a-c2690125e216 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:18.898239 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-17c10dcd-6ff4-4ff9-a409-eac435f0edd0 req-9e859964-1a0f-4346-ae1a-c2690125e216 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:18.898961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-17c10dcd-6ff4-4ff9-a409-eac435f0edd0 req-9e859964-1a0f-4346-ae1a-c2690125e216 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:18.903615 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:18.913966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-17c10dcd-6ff4-4ff9-a409-eac435f0edd0 req-9e859964-1a0f-4346-ae1a-c2690125e216 service nova] Creating event network-vif-deleted:0dd476b1-5ace-4b09-be4d-ba06ef204d1e for instance f41656a6-4409-4e9a-9b29-066443ea6426 on hv-cinder-75670 Sep 19 14:58:18.921748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-17c10dcd-6ff4-4ff9-a409-eac435f0edd0 req-9e859964-1a0f-4346-ae1a-c2690125e216 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038565 Sep 19 14:58:18.927996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 609/719] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:19.461477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:19.462987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:19.472932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.474416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.475086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:19.476068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.476784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.477447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:19.544450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.544945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.546990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:19.547864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lazy-loading 'fault' on Instance uuid f41656a6-4409-4e9a-9b29-066443ea6426 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:58:19.629164 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:19.637976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4548e999-a6d8-47c9-8862-6a58bd05fde7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 200 len: 1327 microversion: 2.1 time: 0.180675 Sep 19 14:58:19.640670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 610/720] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:19 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:19.911816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:19.912817 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:19.927658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.928238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.928713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:19.929902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:19.930387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:19.930845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.178657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.189658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.191557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:20.193096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f2a397d9-b098-4921-88aa-e047ddc1b96a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.286239 Sep 19 14:58:20.193884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 611/721] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:19 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:20.664463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:20.666190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:20.673900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:20.674771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:20.675583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.676484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:20.677622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:20.678283 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:20.703127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] HTTP exception thrown: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Request method failure captured: Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 HTTP/1.1 Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKMGqk5Gb9qGTs4K2omk0zzNoD8qZrlLyBuuSpgu5aiHPr8i0RHQlgJg-Lv4RNCqBXD1LSryW5dgR_ptdRZMSyYqq7GmnCgfa5g9Yhnw3gqCziqieNJ1vY6VvbBpWFSR-Gs9LRKGsg2S5ECvk2xyojIm38fsVV3_BiYfPkF1Ona43g Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:20.706136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a431be4c2f247e2955883eab6a5f555", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 73ef9d62f31d4135b6f079a26d791ca5 Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:58:20.708643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'f41656a6-4409-4e9a-9b29-066443ea6426'} Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:20.709479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:58:20.712655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:20.715302 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Returning 404 to user: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:20.716580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bb4b4f1d-eb6f-47b9-886b-fc8f33ad8cd6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 404 len: 111 microversion: 2.1 time: 0.058458 Sep 19 14:58:20.717148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 612/722] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:20 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:20.728257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a90c1c65-839a-47fd-9b38-448148dd9740 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '.version_select at 0x7f9f39a8b280>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:20.754216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a90c1c65-839a-47fd-9b38-448148dd9740 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913209802" status: 202 len: 0 microversion: 2.1 time: 0.032022 Sep 19 14:58:20.754880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 613/723] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Sep 19 14:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913209802 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:58:21.219871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:21.220874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:21.228841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.229610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.230318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:21.231326 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:21.232032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:21.232671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:21.476361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:21.488851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:21.490815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:21.492383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-31a4c2b0-7843-4e36-af2e-14d33ff9f493 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.277643 Sep 19 14:58:21.513007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 614/724] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:21 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:21.574754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dfda9cdf-ad5c-4a2c-afab-f15c0391771b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: .version_select at 0x7f9f39b15c10>, body: {"keypair": {"name": "tempest-keypair-362106299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUjxfdf0QA47SCSWGm/Vygb1x+rc2D+MftVPj3sXolzTcV/rzJCPRSYw8oGrTRsxw1Vr59GfIcsxZTJ8ur6Vs+QLgWVRQ6mbU3Uba7pBaOMLc+W9QRVmCy7ywsSjY5jQ=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:21.593030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-dfda9cdf-ad5c-4a2c-afab-f15c0391771b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for project 9a431be4c2f247e2955883eab6a5f555. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:58:21.598160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-dfda9cdf-ad5c-4a2c-afab-f15c0391771b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for user 73ef9d62f31d4135b6f079a26d791ca5 and project 9a431be4c2f247e2955883eab6a5f555. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:58:21.601700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:21.632419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dfda9cdf-ad5c-4a2c-afab-f15c0391771b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061796 Sep 19 14:58:21.633172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 615/725] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 14:58:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:22.524872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:22.526176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:22.538144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.539877 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.541919 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.543574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:22.545585 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:22.546038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:22.852151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:22.862648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:22.864901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:22.866638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c436415f-4b5b-4e5a-a7e1-f5a9ec3b3716 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.349540 Sep 19 14:58:22.872830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 616/726] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:22 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:23.486320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-353701665", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "496537bd-479b-43b1-a831-0aca8c81649e"}], "security_groups": [{"name": "tempest-securitygroup--1616156048"}], "key_name": "tempest-keypair-362106299", "user_data": "}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:23.625173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] validate_networks() for [('496537bd-479b-43b1-a831-0aca8c81649e', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:58:24.131472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:58:24.132049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:58:24.132795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:58:24.133464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:58:24.133982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:58:24.148080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.148735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.149442 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.150447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.154103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.155096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.177076 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for project 9a431be4c2f247e2955883eab6a5f555. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:58:24.186375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Getting quotas for user 73ef9d62f31d4135b6f079a26d791ca5 and project 9a431be4c2f247e2955883eab6a5f555. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:58:24.203085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:58:24.207236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:58:24.280068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-240fe024-06ba-4b56-932b-0fc66852e431 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.799197 Sep 19 14:58:24.282840 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 617/727] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:58:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:58:24.293652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:24.295066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:24.306141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.308477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.309288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.310203 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:24.311083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:24.311713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:24.523080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:24.531619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:24.534290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:24.536637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0da39386-c958-4445-a1e3-d788b149c889 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1739 microversion: 2.20 time: 0.252215 Sep 19 14:58:24.540563 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 618/728] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:24 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:24.556436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b685cd3e-7c45-49d8-b2df-2129c2e9097e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:24.557324 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b685cd3e-7c45-49d8-b2df-2129c2e9097e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:24.643666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b685cd3e-7c45-49d8-b2df-2129c2e9097e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:24.652740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b685cd3e-7c45-49d8-b2df-2129c2e9097e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1236 microversion: 2.1 time: 0.106666 Sep 19 14:58:24.655166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 619/729] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:24 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:25.569904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:25.570583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:25.577992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:25.578492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:25.578934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.579640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:25.581046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:25.581484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.721351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.731108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.732814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.734406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6f2be898-d233-4eb5-a140-b6fa8b538ff1 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1721 microversion: 2.20 time: 0.170228 Sep 19 14:58:25.734991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 620/730] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:25 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:25.739810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:25.740636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:25.755242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:25.755810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:25.756349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.757055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:25.757508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:25.757961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:25.827470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:25.835711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8966985f-2f72-4fb3-a5c8-ef3b779acc1c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1288 microversion: 2.1 time: 0.099602 Sep 19 14:58:25.836310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 621/731] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:25 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:26.761349 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:26.761976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:26.769570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:26.770095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:26.770534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:26.771239 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:26.771882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:26.772498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:27.115073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:27.130220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:27.133116 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:27.134598 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-215e6a92-dc89-4b3f-8d9b-b6ba6cecf85b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1721 microversion: 2.20 time: 0.378724 Sep 19 14:58:27.135918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 622/732] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:26 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:27.142137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:27.143753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:27.152547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:27.153321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:27.154034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:27.154905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:27.155596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:27.156215 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:27.240811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:27.250889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-405a6f4f-3bb6-49e1-9305-c5029c182e38 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1294 microversion: 2.1 time: 0.113653 Sep 19 14:58:27.251600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 623/733] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:27 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:28.163171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:28.163852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:28.170350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:28.170840 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:28.171281 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:28.172006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:28.172458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:28.172901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:28.305467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:28.313842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:28.315383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:28.316576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b7d7a323-ad2b-474c-9f17-20d7dbdc8d74 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1721 microversion: 2.20 time: 0.157350 Sep 19 14:58:28.317139 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 624/734] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:28 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:28.321545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:28.322180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:28.327950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:28.328377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:28.328813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:28.329499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:28.329949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:28.330911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:28.460900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:28.468958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-feebb0e3-1e5c-4df4-8d43-91e4bcc69ded tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.150867 Sep 19 14:58:28.469530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 625/735] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:28 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:29.342851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:29.343515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:29.350727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.351224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.351663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.352394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.352850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.353274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.582889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:29.593884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:29.595526 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:29.597366 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c3bfed5f-b30c-4878-80d9-0889563a29c0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1724 microversion: 2.20 time: 0.258568 Sep 19 14:58:29.598041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 626/736] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:29 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:29.603138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-fe2e504e-23d7-4361-b02c-1eca95c3253e req-fd1bf594-7fc8-44b6-ab05-c9e02822ebde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "name": "network-vif-unplugged", "status": "completed", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:29.615594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-fe2e504e-23d7-4361-b02c-1eca95c3253e req-fd1bf594-7fc8-44b6-ab05-c9e02822ebde service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.616264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-fe2e504e-23d7-4361-b02c-1eca95c3253e req-fd1bf594-7fc8-44b6-ab05-c9e02822ebde service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.616989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-fe2e504e-23d7-4361-b02c-1eca95c3253e req-fd1bf594-7fc8-44b6-ab05-c9e02822ebde service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.629303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.compute.server_external_events [req-fe2e504e-23d7-4361-b02c-1eca95c3253e req-fd1bf594-7fc8-44b6-ab05-c9e02822ebde service nova] Unable to find a host for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48. Dropping event network-vif-unplugged {{(pid=126870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 14:58:29.630390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-fe2e504e-23d7-4361-b02c-1eca95c3253e req-fd1bf594-7fc8-44b6-ab05-c9e02822ebde service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030955 Sep 19 14:58:29.631069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 627/737] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 14:58:29.636002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:29.636611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:29.642518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.643014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.643453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.644242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.644706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.645133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.885969 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:29.894313 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0620cf2e-50de-44ba-959d-7df00698815d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.262196 Sep 19 14:58:29.894881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 628/738] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:29 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:29.902956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-234d2ad6-09a9-454d-8fab-50c4110b1d21 req-8ccdc1fd-b49a-41ea-83b1-06cf2d054e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2", "tag": "2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:29.909974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-234d2ad6-09a9-454d-8fab-50c4110b1d21 req-8ccdc1fd-b49a-41ea-83b1-06cf2d054e47 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.910454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-234d2ad6-09a9-454d-8fab-50c4110b1d21 req-8ccdc1fd-b49a-41ea-83b1-06cf2d054e47 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.910904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-234d2ad6-09a9-454d-8fab-50c4110b1d21 req-8ccdc1fd-b49a-41ea-83b1-06cf2d054e47 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.921998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-234d2ad6-09a9-454d-8fab-50c4110b1d21 req-8ccdc1fd-b49a-41ea-83b1-06cf2d054e47 service nova] Creating event network-changed:2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978 for instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 on hv-cinder-75670 Sep 19 14:58:29.927415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-234d2ad6-09a9-454d-8fab-50c4110b1d21 req-8ccdc1fd-b49a-41ea-83b1-06cf2d054e47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031403 Sep 19 14:58:29.928081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 629/739] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:29.933910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a774f3a3-fe19-458d-897e-550c35a847e1"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:29.936895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:29.943120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.943605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.944070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:29.944862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:29.945222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:29.945739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.136141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:30.230217 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c1a693e2-5aa3-4ea7-b7d9-028d54c489bf tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300560 Sep 19 14:58:30.230823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 630/740] 10.222.0.60 () {62 vars in 1364 bytes} [Mon Sep 19 14:58:29 2022] POST /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 14:58:30.362362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:30.363006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:30.369631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.370120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.370566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.371272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.371730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.372187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.617781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ef93596c-fdf3-4b94-bc5c-f9dd1aab548d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-volume_attachments/a774f3a3-fe19-458d-897e-550c35a847e1" status: 202 len: 0 microversion: 2.20 time: 0.259606 Sep 19 14:58:30.618384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 631/741] 10.222.0.60 () {60 vars in 1457 bytes} [Mon Sep 19 14:58:30 2022] DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-volume_attachments/a774f3a3-fe19-458d-897e-550c35a847e1 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 14:58:30.682260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:30.682863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:30.688787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.689301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.689707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.690393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.690846 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.691270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.721855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126870) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 14:58:30.788419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-03bcc5ba-8af7-478b-9a87-507d7ed252b5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "POST /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/action" status: 202 len: 0 microversion: 2.20 time: 0.110268 Sep 19 14:58:30.789419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 632/742] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Sep 19 14:58:30 2022] POST /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:58:30.797048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:30.797791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:30.804372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.804868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.805343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.806045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.806503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.806930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.950360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:30.959295 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:30.960770 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:30.962171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f9c34072-5e26-4eac-b493-e9b4e81ceba0 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1672 microversion: 2.20 time: 0.168888 Sep 19 14:58:30.962983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 633/743] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:30 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:30.968080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:30.968684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:30.976090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.976566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.977007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:30.977699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:30.978176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:30.978848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:31.209569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:31.217394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-47c9329a-a96d-434c-b211-fdaebd2ff255 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.253402 Sep 19 14:58:31.218367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 634/744] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:30 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:31.989913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:31.991346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:31.998103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:31.998931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:31.999640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:32.000672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:32.001440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:32.002597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:32.183484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:32.195528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:32.197300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:32.198666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c922ac7c-4a85-4e12-9fdd-26fc7d9a0214 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1674 microversion: 2.20 time: 0.213299 Sep 19 14:58:32.199670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 635/745] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:31 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:32.242806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:32.243691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:32.252481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:32.253649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:32.254094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:32.254865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:32.255494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:32.255959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:32.412120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:32.419816 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1c3f24d6-2b23-4196-aee6-ca11260dafd3 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.183414 Sep 19 14:58:32.420409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 636/746] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:32 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:33.228609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:33.229971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:33.237734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:33.238309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:33.239000 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:33.239924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:33.240419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:33.241027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:33.458739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:33.468421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:33.470262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:33.471712 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-762b04b1-bf2c-4954-a4a0-ad21ef5593be tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.248508 Sep 19 14:58:33.472774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 637/747] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:33 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:33.478487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:33.479179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:33.485524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:33.486944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:33.487852 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:33.488858 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:33.489605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:33.490258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:33.723243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:33.734997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-569e8dd5-3d17-4921-83d5-fa6df7b5d48b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.260919 Sep 19 14:58:33.736677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 638/748] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:33 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:34.499355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:34.500884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:34.504952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:34.510206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:34.510758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:34.511429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:34.512379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:34.512892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:34.513382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:34.651151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=12 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:34.660273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:34.669993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:34.671712 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:34.672987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fa608cb3-e6a1-4b01-a675-491de79dc888 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.177957 Sep 19 14:58:34.673650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 639/749] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:34 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:34.760133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:34.760715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:34.769252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:34.769691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:34.770132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:34.771027 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:34.771643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:34.772296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:34.930868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:34.940295 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-30328114-bb03-4f50-af59-08fe2d1b90e4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.184016 Sep 19 14:58:34.957013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 640/750] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:34 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:35.461944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-cb8edc37-f45c-408c-ade1-a0b4f73e658d req-60205cd1-41bd-402a-b441-64873b69fee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2", "name": "network-vif-plugged", "status": "completed", "tag": "2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:35.482695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb8edc37-f45c-408c-ade1-a0b4f73e658d req-60205cd1-41bd-402a-b441-64873b69fee8 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.483573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb8edc37-f45c-408c-ade1-a0b4f73e658d req-60205cd1-41bd-402a-b441-64873b69fee8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.484285 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cb8edc37-f45c-408c-ade1-a0b4f73e658d req-60205cd1-41bd-402a-b441-64873b69fee8 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:35.497386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-cb8edc37-f45c-408c-ade1-a0b4f73e658d req-60205cd1-41bd-402a-b441-64873b69fee8 service nova] Creating event network-vif-plugged:2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978 for instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 on hv-cinder-75670 Sep 19 14:58:35.503995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-cb8edc37-f45c-408c-ade1-a0b4f73e658d req-60205cd1-41bd-402a-b441-64873b69fee8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 Sep 19 14:58:35.505586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 641/751] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:35.705650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:35.706691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:35.716862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.717649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.718340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:35.719404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.720149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.720899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:35.884515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:35.894499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:35.896378 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:35.897771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a947c56e-f032-491f-a6a3-1e655a3da38d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.200842 Sep 19 14:58:35.898542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 642/752] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:35 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:35.964945 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:35.965545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:35.972661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.973184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.973609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:35.974322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:35.974874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:35.975310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:35.978453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=87,nova_cell1:UPDATE=8 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:36.153502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:36.163905 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-32620b46-c5a2-43e4-af0f-0ca7df735df7 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.202614 Sep 19 14:58:36.164890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 643/753] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:35 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:36.925023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:36.925728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:36.933740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:36.934301 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:36.934782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:36.935564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:36.936109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:36.936593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:37.090257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:37.098977 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:37.100484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:37.101692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b4c69e2b-5050-45fb-9495-c308fb4b1435 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.181324 Sep 19 14:58:37.102455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 644/754] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:36 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:37.194763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:37.195274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:37.201440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:37.201922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:37.202353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:37.203049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:37.203496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:37.203941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:37.343567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:37.350095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f42eca30-ce63-4a46-bf56-3311f8bae27e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.159308 Sep 19 14:58:37.350682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 645/755] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:37 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:38.128284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:38.128935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:38.135915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:38.136453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:38.136954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:38.137699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:38.138191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:38.138654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:38.281444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:38.290352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:38.291803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:38.293003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fd76471d-2453-4ec3-8b37-fb2d05d1fd8a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.168838 Sep 19 14:58:38.293842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 646/756] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:38 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:38.375003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:38.375541 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:38.382612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:38.383115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:38.383556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:38.384313 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:38.384773 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:38.385199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:38.781641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:38.790554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6c7d92e1-5ae5-43d9-820f-ee703d9f751a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.420130 Sep 19 14:58:38.791131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 647/757] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:38 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:39.320057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:39.320756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:39.327446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.328031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.328509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.329287 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.329785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.330207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.506784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:39.516239 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:39.518470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:39.520034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-80c3df07-2649-4a0a-984b-1c930e593c52 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.204340 Sep 19 14:58:39.520827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 648/758] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:39 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:39.816919 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:39.821467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:39.826241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.826793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.827224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.828051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:39.828502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:39.828928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:39.979706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:39.988713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-41fbc44f-1ff7-44f9-a4a8-3a58854143b8 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.178992 Sep 19 14:58:39.989471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 649/759] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:39 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:40.546798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:40.547478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:40.554750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:40.555236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:40.555677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:40.556434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:40.556875 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:40.557572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:40.699619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:40.708677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:40.710404 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:40.711658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-85e3e8de-1bb1-4ebe-aefd-6f9592cdb1d6 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.168991 Sep 19 14:58:40.712460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 650/760] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:40 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:41.012128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:41.012782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:41.020389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:41.025158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.025713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.026171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.026949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.027457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.027913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.215192 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:41.224060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-621c42de-0005-425e-b58e-29cefde0408b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.215802 Sep 19 14:58:41.224972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 651/761] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:41 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:41.676183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:41.676893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:41.683882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.684397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.684830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.685698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.686166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.686614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.718906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:58:41.814520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ac5f5011-197e-45ea-8d70-9912095e8dc0 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 204 len: 0 microversion: 2.1 time: 0.141977 Sep 19 14:58:41.815780 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 652/762] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:58:41 2022] DELETE /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:58:41.821142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:41.821942 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:41.828548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.829034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.829468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.830218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:41.830664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:41.831083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:41.976532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:41.985869 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:41.987567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:41.989056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0acafb78-6048-430a-a31b-a0d217d7cda5 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.172103 Sep 19 14:58:41.990880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 653/763] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:41 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:41.995985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:41.996595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:42.006944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:42.007445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:42.007940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:42.008648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:42.009105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:42.009529 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:42.150446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:42.159156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-487b9de4-f4d8-4fa4-9ea3-863c97c82d0b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1577 microversion: 2.1 time: 0.167013 Sep 19 14:58:42.159939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 654/764] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:41 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:42.246884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:42.247422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:42.253854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:42.254346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:42.254788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:42.255519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:42.256006 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:42.256437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:42.394822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:42.402542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d88181ec-af39-4fbb-a8c6-bdc8096b95aa tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.159704 Sep 19 14:58:42.403095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 655/765] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:42 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:43.015844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:43.016578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:43.023912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.024427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.024873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.025574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.026033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.026459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.155414 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:43.163597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:43.165115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:43.166286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-64ce3d66-1d3c-4e09-a5d9-a08f4a3f2c6d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.154452 Sep 19 14:58:43.166843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 656/766] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:43 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:43.182408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:43.183010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:43.189411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.189896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.190329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.191044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.191495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.191951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.329204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:43.337153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-01c740c0-7d92-4372-a276-121d8a5e2677 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1577 microversion: 2.1 time: 0.158634 Sep 19 14:58:43.337724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 657/767] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:43 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:43.426424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:43.427075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:43.433855 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.434488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.435060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.435777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.436266 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.436697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.440593 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:43.573605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:43.581325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-68318d9c-dfee-4e71-bb07-8ead3d050098 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.159544 Sep 19 14:58:43.581885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 658/768] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:43 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:43.879426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:43.880002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:43.886429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.886920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.887362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.888098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:43.888557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:43.888993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:43.916546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-341c6d5d-ea78-4434-b368-04640c189295 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/ips" status: 200 len: 150 microversion: 2.1 time: 0.041139 Sep 19 14:58:43.917277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 659/769] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:58:43 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:44.191081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:44.191691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:44.197883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:44.198372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:44.198815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:44.200316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:44.200484 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:44.200988 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:44.346937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.355740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.357251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.358445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e111a353-5a8e-4bd3-8f7e-befd9b5d330e tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.171266 Sep 19 14:58:44.359019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 660/770] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:44 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:44.364194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:44.364734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:44.370562 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:44.371038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:44.371468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:44.372179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:44.372631 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:44.373048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:44.520303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.528142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d1449ecb-b0c0-4558-a744-efe08f49ae83 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1577 microversion: 2.1 time: 0.168105 Sep 19 14:58:44.528742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 661/771] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:44 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:44.606208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:44.606827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:44.612989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:44.613531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:44.614014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:44.614815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:44.615437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:44.615973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:44.754431 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:44.763617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-84cbf3dd-bf7d-4996-aab5-03acaacd1f34 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.161123 Sep 19 14:58:44.766775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 662/772] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:44 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:45.293314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "109cce80-9148-4895-bdd6-0a4277d6ccb7"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:45.295844 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:45.302827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.303331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.303761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.304487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.304933 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.305353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.568227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bb08533a-f258-4057-88e4-05a45f235376 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "POST /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278662 Sep 19 14:58:45.569056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 663/773] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:58:45 2022] POST /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:45.577430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:45.578229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:45.585904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.586495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.587037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.587871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.588425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.588971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.794625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:45.804462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:45.805931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:45.807377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4c0d2a82-27a1-42f9-9621-3a10e86e3723 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.234155 Sep 19 14:58:45.807970 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 664/774] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:45 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:45.812506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:45.813147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:45.819964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.820453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.820892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:45.821586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:45.822039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:45.822462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.052936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:46.061444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-65cf1d24-c008-43b1-b2b5-fa5e5153867b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1577 microversion: 2.1 time: 0.252466 Sep 19 14:58:46.062031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 665/775] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:45 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:46.069105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:46.070177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:46.077895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.078461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.079021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.079840 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.080300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.080722 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.303112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:46.312156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f6c945eb-1bb2-4c82-ba20-09257ebca914 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1362 microversion: 2.1 time: 0.248853 Sep 19 14:58:46.328210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 666/776] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:46 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:46.560660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-5c58e525-7511-4a0c-bdb8-259bfe4e27a5 req-8f968279-68ec-44d3-b9b7-f8f1f3a29b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e15404-48df-4490-8dc2-f0f5308f06f7", "name": "network-vif-deleted", "tag": "238639e7-7652-49a7-a143-93ed41e99dad"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:46.572468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5c58e525-7511-4a0c-bdb8-259bfe4e27a5 req-8f968279-68ec-44d3-b9b7-f8f1f3a29b74 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.573253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5c58e525-7511-4a0c-bdb8-259bfe4e27a5 req-8f968279-68ec-44d3-b9b7-f8f1f3a29b74 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.574235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5c58e525-7511-4a0c-bdb8-259bfe4e27a5 req-8f968279-68ec-44d3-b9b7-f8f1f3a29b74 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.586474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-5c58e525-7511-4a0c-bdb8-259bfe4e27a5 req-8f968279-68ec-44d3-b9b7-f8f1f3a29b74 service nova] Creating event network-vif-deleted:238639e7-7652-49a7-a143-93ed41e99dad for instance 15e15404-48df-4490-8dc2-f0f5308f06f7 on hv-cinder-75670 Sep 19 14:58:46.591647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-5c58e525-7511-4a0c-bdb8-259bfe4e27a5 req-8f968279-68ec-44d3-b9b7-f8f1f3a29b74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 Sep 19 14:58:46.592331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 667/777] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:46.837557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:46.838167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:46.848463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.849184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.850468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:46.851357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:46.852168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:46.852602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.001947 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:47.010176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:47.011649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:47.012893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d5c16f99-69f7-4cb4-b0f2-e32f9fcf2c71 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.179744 Sep 19 14:58:47.014233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 668/778] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:46 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:47.086408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:47.087019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:47.093511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.094186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.095094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.097082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.098021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.098476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.131898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.132381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.132813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.133256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lazy-loading 'fault' on Instance uuid 15e15404-48df-4490-8dc2-f0f5308f06f7 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:58:47.178642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:47.186571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e443b981-c9b6-4e67-951b-0544882ee057 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 200 len: 1230 microversion: 2.1 time: 0.104190 Sep 19 14:58:47.187125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 669/779] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:47 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:47.337155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:47.337773 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:47.344058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.344786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.345415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.346127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.346586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.347201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.510506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:47.526964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7603cbab-4a2d-4aea-b2f3-1e91278eba25 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1549 microversion: 2.1 time: 0.193691 Sep 19 14:58:47.527640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 670/780] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:47 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:47.551795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:47.552594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:47.560422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.561182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.561787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.562656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:47.563276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:47.564521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:47.651040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dd82992a-a21d-4f82-8030-93afa9128196 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104340 Sep 19 14:58:47.651639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 671/781] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Sep 19 14:58:47 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:48.041780 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:48.042381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:48.048427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.048971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.049360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.050049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.050496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.050911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.270182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.278472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.279950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:48.281123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f29c5de3-bb1a-4854-bb9b-7e2ad4de160a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.243286 Sep 19 14:58:48.281674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 672/782] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:48 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:48.286382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:48.286934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:48.293270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.293758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.294188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.294894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:48.295343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:48.295760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:48.310280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] HTTP exception thrown: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Request method failure captured: Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 HTTP/1.1 Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKILk8os_wV2A--XhLR4eg4VZ6mQzL5yc_UwjYrreAv2F5YiSX9_970-dkUEL9YQXzp9bfU67X1HV4XnBtQYEdRx3zbEHSrW9hkEdN7UDtE24VxjZn3RXW1VYOaq3Qg_iqPDZu_ZWDNmitoIvUD_8GTBntna8D6Fhwkal32aStMfzzGA Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:48.311982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbb13ea6de2a48e99ce93be06fd87830", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestVolumeBootPattern-344033396 Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestVolumeBootPattern-344033396-project Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 52173f24f42a481380b047abe76bca57 Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestVolumeBootPattern-344033396-project Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 14:58:48.314256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '15e15404-48df-4490-8dc2-f0f5308f06f7'} Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:48.315312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 14:58:48.317112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:48.318460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Returning 404 to user: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:48.318460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-38a8a396-97f8-4395-be90-95526991e461 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 404 len: 111 microversion: 2.1 time: 0.030742 Sep 19 14:58:48.318460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 673/783] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:48 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:48.413114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1623041977", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-579270075", "security_groups": [{"name": "tempest-secgroup-smoke-591621420"}], "block_device_mapping_v2": [{"uuid": "699659ab-8cd3-4983-b642-4f9c02a9f564", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fec6bb0-9f94-43d5-b3e5-a726dd57258c"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:48.800663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] validate_networks() for [('2fec6bb0-9f94-43d5-b3e5-a726dd57258c', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:58:49.283345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:58:49.283804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:58:49.284400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:58:49.284811 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:58:49.285221 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:58:49.293871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.294357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.294798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.295520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.296001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.296429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.314815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:58:49.318716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for user 52173f24f42a481380b047abe76bca57 and project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:58:49.376951 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:58:49.379143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='699659ab-8cd3-4983-b642-4f9c02a9f564',volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:58:49.514427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c837bb21-0c5b-4223-a858-aa3486a6bd1f tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.105146 Sep 19 14:58:49.515486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 674/784] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:58:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 14:58:49.520658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-81f66852-c73a-4eba-82a6-2481a027fe4b req-845cee6c-e477-4bc1-b8d9-fd3f96857183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2", "tag": "2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:49.531234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-81f66852-c73a-4eba-82a6-2481a027fe4b req-845cee6c-e477-4bc1-b8d9-fd3f96857183 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.532333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-81f66852-c73a-4eba-82a6-2481a027fe4b req-845cee6c-e477-4bc1-b8d9-fd3f96857183 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.532333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-81f66852-c73a-4eba-82a6-2481a027fe4b req-845cee6c-e477-4bc1-b8d9-fd3f96857183 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.544451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-81f66852-c73a-4eba-82a6-2481a027fe4b req-845cee6c-e477-4bc1-b8d9-fd3f96857183 service nova] Creating event network-changed:2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978 for instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 on hv-cinder-75670 Sep 19 14:58:49.550234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-81f66852-c73a-4eba-82a6-2481a027fe4b req-845cee6c-e477-4bc1-b8d9-fd3f96857183 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033493 Sep 19 14:58:49.551096 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 675/785] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:49.566388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:49.567527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:49.574775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.575621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.576198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.577375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:49.578343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:49.580084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:49.608252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:49.851463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.866864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.869143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:49.870794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f3273bb8-6ab6-40e2-bfe9-950f31a74930 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.310055 Sep 19 14:58:49.871612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 676/786] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:49 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:49.901950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-47503f79-1576-4357-888e-a9390eba0e12 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:49.902661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-47503f79-1576-4357-888e-a9390eba0e12 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:50.004201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-47503f79-1576-4357-888e-a9390eba0e12 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:50.019966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-47503f79-1576-4357-888e-a9390eba0e12 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1094 microversion: 2.1 time: 0.131271 Sep 19 14:58:50.020904 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 677/787] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:49 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:50.030390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-2278053b-0ddb-4b28-a6a6-5e58f3b50874 req-518f71b3-65e7-42f6-9485-a50fcdc40fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "name": "network-vif-plugged", "status": "completed", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:50.052946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2278053b-0ddb-4b28-a6a6-5e58f3b50874 req-518f71b3-65e7-42f6-9485-a50fcdc40fcf service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.054547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2278053b-0ddb-4b28-a6a6-5e58f3b50874 req-518f71b3-65e7-42f6-9485-a50fcdc40fcf service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.055695 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2278053b-0ddb-4b28-a6a6-5e58f3b50874 req-518f71b3-65e7-42f6-9485-a50fcdc40fcf service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:50.069647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2278053b-0ddb-4b28-a6a6-5e58f3b50874 req-518f71b3-65e7-42f6-9485-a50fcdc40fcf service nova] Creating event network-vif-plugged:274e690b-1c6b-4790-9dc2-5dbe545e77ae for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 on hv-cinder-75670 Sep 19 14:58:50.075292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-2278053b-0ddb-4b28-a6a6-5e58f3b50874 req-518f71b3-65e7-42f6-9485-a50fcdc40fcf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048544 Sep 19 14:58:50.076650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 678/788] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:50.903360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:50.904060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:50.911320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.911795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.912250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:50.912938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:50.913386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:50.913805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.044894 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.053169 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.054638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.055910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-733d4169-e949-40c7-bd6b-a16b4e0ce218 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.156936 Sep 19 14:58:51.056507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 679/789] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:50 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:58:51.061662 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:51.062269 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:51.068959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.069452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.069998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.070785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:51.071294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:51.071765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:51.136821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:51.145065 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0c8fb01e-9ea7-4d24-ba0e-8f385398fa2c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1192 microversion: 2.1 time: 0.087281 Sep 19 14:58:51.145637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 680/790] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:51 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:52.088920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:52.090346 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:52.100514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.101067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.101742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:52.102656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.103191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.105560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:52.358908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:52.375094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:52.376611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:52.377793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3790e6f4-59a4-4ae5-b5a0-d9eff720e771 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1730 microversion: 2.20 time: 0.298042 Sep 19 14:58:52.378357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 681/791] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:52 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:52.382805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:52.383406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:52.389306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.389789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.390226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:52.390921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.391370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.392399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:52.593630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:52.602724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e545b6e2-4e8a-4838-97da-8270401a7ed8 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1277 microversion: 2.1 time: 0.223354 Sep 19 14:58:52.603307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 682/792] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:52 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:52.949613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-5d3071ce-f1a1-457d-98d7-ada9e59898cc req-be37303f-10bd-4ce7-9b40-1ae7eee7b229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b2c21d-ef12-47b1-8ac7-43a6eb30d996", "tag": "e9e7dc81-3f4f-4517-bb50-4f763916413d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:52.978983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5d3071ce-f1a1-457d-98d7-ada9e59898cc req-be37303f-10bd-4ce7-9b40-1ae7eee7b229 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:52.981729 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5d3071ce-f1a1-457d-98d7-ada9e59898cc req-be37303f-10bd-4ce7-9b40-1ae7eee7b229 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:52.982659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5d3071ce-f1a1-457d-98d7-ada9e59898cc req-be37303f-10bd-4ce7-9b40-1ae7eee7b229 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.011251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-5d3071ce-f1a1-457d-98d7-ada9e59898cc req-be37303f-10bd-4ce7-9b40-1ae7eee7b229 service nova] Creating event network-changed:e9e7dc81-3f4f-4517-bb50-4f763916413d for instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 on hv-cinder-75670 Sep 19 14:58:53.016835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-5d3071ce-f1a1-457d-98d7-ada9e59898cc req-be37303f-10bd-4ce7-9b40-1ae7eee7b229 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080699 Sep 19 14:58:53.017868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 683/793] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:53.363133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:53.363896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:53.372703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.373267 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.373791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.374602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.375119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.375610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.476307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lazy-loading 'services' on Instance uuid 243344cf-34e7-491b-8cd6-33923aeff28e {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:58:53.555324 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-95075afd-4aa1-4093-aa69-a4157711c345 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments/109cce80-9148-4895-bdd6-0a4277d6ccb7" status: 202 len: 0 microversion: 2.1 time: 0.198357 Sep 19 14:58:53.555885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 684/794] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:58:53 2022] DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments/109cce80-9148-4895-bdd6-0a4277d6ccb7 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:58:53.565085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:53.566279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:53.573466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.573959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.574425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.575148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.575605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.576068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.705488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.713833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.715322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.716520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e826c52a-07ca-4bea-af88-642f5a13a33a tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1717 microversion: 2.20 time: 0.159517 Sep 19 14:58:53.717077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 685/795] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:58:53 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 14:58:53.722178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:53.724447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:53.730452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.730902 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.731339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.732078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.732518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.732947 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.768532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7f549e0c-61d2-4a03-b1fd-cd7abbd6c030 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050335 Sep 19 14:58:53.773607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 686/796] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:58:53 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:58:53.773766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:53.774296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:53.780130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.780620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.781051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.781753 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:53.782327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:53.783241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:53.944334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:53.952032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fbaed7d5-408b-4ea0-8933-13b7e546a731 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.181902 Sep 19 14:58:53.952620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 687/797] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:53 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:54.781390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:54.784367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:54.788021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:54.792200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.792680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.793122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.793813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.794264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.794684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.825468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-da87703d-1a09-4bef-9694-6fa1a8bd71f6 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048097 Sep 19 14:58:54.826019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 688/798] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:58:54 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 14:58:54.889813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:54.890309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:54.896985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.897464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.897896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.898584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:54.899039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:54.899466 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:54.923979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:58:54.998664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c0274a69-1ab4-4a7f-ab78-ab8208f2cffd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 204 len: 0 microversion: 2.1 time: 0.112370 Sep 19 14:58:54.999296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 689/799] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:58:54 2022] DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:58:55.006893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:55.007599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:55.013657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.014143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.014584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.015282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.015742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.016461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.149403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:55.157422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f2354c8d-5a41-4341-9a7c-64e653a062e3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.156176 Sep 19 14:58:55.157997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 690/800] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:54 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:55.162578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:55.163181 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:55.169011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.169497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.169935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.170629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:55.171083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:55.171511 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:55.300146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:55.308311 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-43e3e3c3-c289-4780-9619-33ff497fe9bd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1680 microversion: 2.1 time: 0.149304 Sep 19 14:58:55.308891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 691/801] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:55 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:56.179109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:56.179757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:56.186677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.187235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.187680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.188627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.189165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.189590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.321950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:56.330871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7f53c784-b1ba-48ab-9ee2-f02e6a9f866d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.155567 Sep 19 14:58:56.331438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 692/802] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:56 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:56.335897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:56.336505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:56.342258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.342679 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.343118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.343808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:56.344290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:56.344718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:56.348782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:58:56.502530 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:56.510564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-74dd5ba8-0e6f-4c39-8941-c77b8682c72b tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1680 microversion: 2.1 time: 0.178094 Sep 19 14:58:56.511146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 693/803] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:56 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:57.296457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-1411fd0f-30f6-440c-a84d-40eab4d6dd83 req-42b9d020-5b5b-48f8-85ea-0d07a237ecbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243344cf-34e7-491b-8cd6-33923aeff28e", "name": "network-vif-deleted", "tag": "d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:58:57.307738 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1411fd0f-30f6-440c-a84d-40eab4d6dd83 req-42b9d020-5b5b-48f8-85ea-0d07a237ecbc service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.308255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1411fd0f-30f6-440c-a84d-40eab4d6dd83 req-42b9d020-5b5b-48f8-85ea-0d07a237ecbc service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.308688 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1411fd0f-30f6-440c-a84d-40eab4d6dd83 req-42b9d020-5b5b-48f8-85ea-0d07a237ecbc service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.320554 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-1411fd0f-30f6-440c-a84d-40eab4d6dd83 req-42b9d020-5b5b-48f8-85ea-0d07a237ecbc service nova] Creating event network-vif-deleted:d0f3724b-a16b-49e2-8d1a-cd0dcb86dc3b for instance 243344cf-34e7-491b-8cd6-33923aeff28e on hv-cinder-75670 Sep 19 14:58:57.325692 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-1411fd0f-30f6-440c-a84d-40eab4d6dd83 req-42b9d020-5b5b-48f8-85ea-0d07a237ecbc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Sep 19 14:58:57.326609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 694/804] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:58:57.358379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:57.359141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:57.365986 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.366684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.367339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.368247 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.368860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.369618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.542687 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:57.556166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-41487556-377f-4510-b29a-cb6f1db0fd31 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.205791 Sep 19 14:58:57.564948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 695/805] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:57 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:57.564948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:57.564948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:57.569531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.570026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.570467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.571226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.571686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.572201 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.607528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:57.608074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:57.608582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:57.609103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lazy-loading 'fault' on Instance uuid 243344cf-34e7-491b-8cd6-33923aeff28e {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:58:57.652491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61743a63def7451d9b739f3b17afe8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89056beeba940128ec6ff72b0c55b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:57.660217 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cf4fa43d-7ec2-4338-b70b-9a75e7fa7085 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 200 len: 1329 microversion: 2.1 time: 0.101762 Sep 19 14:58:57.660792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 696/806] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:57 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:58:58.581932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:58.582557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:58.589022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.589503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.589948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.590636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.591095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.591518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.973508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:58:58.981130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-73383bd0-f69b-4716-aa51-cd56090bfb4b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.403848 Sep 19 14:58:58.981690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 697/807] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:58 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:58:58.986581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:58.987183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:58:58.992754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.993234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.993672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:58.994356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:58:58.994804 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:58:58.995225 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:58:59.009028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e HTTP/1.1 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:58:59.010667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:58:59.012315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '243344cf-34e7-491b-8cd6-33923aeff28e'} Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:58:59.013233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:58:59.014707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:58:59.016146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:58:59.016146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-26330cb0-e18f-4f9f-a43a-541b68e0c3b2 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 404 len: 111 microversion: 2.1 time: 0.029432 Sep 19 14:58:59.016146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 698/808] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:58 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:58:59.020608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6e904c34-0740-4695-9ae8-4823b6e5345c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '.version_select at 0x7f9f399cbf70>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:58:59.039252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6e904c34-0740-4695-9ae8-4823b6e5345c tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-721797173" status: 202 len: 0 microversion: 2.1 time: 0.022103 Sep 19 14:58:59.039843 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 699/809] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Sep 19 14:58:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-721797173 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:59:00.001661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:00.006441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.007083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.014174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.014654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.015086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.015771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.016250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.017245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.017675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=8 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:00.153761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:00.161857 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f7ec7557-1350-43ce-9791-92b54e5dd03b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.161381 Sep 19 14:59:00.162493 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 700/810] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:58:59 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:00.812558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.813052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.819661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.820162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.820592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.821268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.821714 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.822131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.835156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e HTTP/1.1 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:00.836727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.838407 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '243344cf-34e7-491b-8cd6-33923aeff28e'} Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:00.839550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.841103 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.842744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:00.842744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2ddaad83-9de3-4e05-8181-3516942b2828 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 404 len: 111 microversion: 2.1 time: 0.029372 Sep 19 14:59:00.842744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 701/811] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:00 2022] DELETE /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:00.846576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:00.847174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 243344cf-34e7-491b-8cd6-33923aeff28e] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:00.852809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.853280 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.853711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.854384 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:00.854826 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:00.855245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:00.868893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e HTTP/1.1 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:00.870400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.872023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '243344cf-34e7-491b-8cd6-33923aeff28e'} Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:00.872917 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. Sep 19 14:59:00.874165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:00.875240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance 243344cf-34e7-491b-8cd6-33923aeff28e could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:00.875240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e3e89c06-5340-4bdc-83b9-40e5fe9889f9 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e" status: 404 len: 111 microversion: 2.1 time: 0.029230 Sep 19 14:59:00.875240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 702/812] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:00 2022] GET /compute/v2.1/servers/243344cf-34e7-491b-8cd6-33923aeff28e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:01.184537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:01.185149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:01.191686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:01.192211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:01.192657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:01.193350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:01.193809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:01.194241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:01.325786 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:01.334451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ed0b81fe-37be-441d-bf06-7dee5b25e971 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.154180 Sep 19 14:59:01.335013 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 703/813] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:01 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:02.019900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:02.020496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.027602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.028395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.028997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.029760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.030217 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.031317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.045640 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af HTTP/1.1 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:02.047200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.048792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'cf690c71-c2d4-432f-b912-4d9b0918f3af'} Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:02.049618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.050838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.052499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:02.052499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-00ff95f4-1856-4e06-81c7-62b4fb067093 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 404 len: 111 microversion: 2.1 time: 0.033122 Sep 19 14:59:02.052499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 704/814] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:02 2022] DELETE /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:02.056988 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:02.057801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: cf690c71-c2d4-432f-b912-4d9b0918f3af] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.063579 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.064108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.064546 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.065249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.065697 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.066126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.080147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af HTTP/1.1 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:02.081800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.083793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'cf690c71-c2d4-432f-b912-4d9b0918f3af'} Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:02.084740 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. Sep 19 14:59:02.086156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.087380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance cf690c71-c2d4-432f-b912-4d9b0918f3af could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:02.087380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2770cafa-e9de-4e12-9978-1b0da8e122e4 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af" status: 404 len: 111 microversion: 2.1 time: 0.030076 Sep 19 14:59:02.087380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 705/815] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:02 2022] GET /compute/v2.1/servers/cf690c71-c2d4-432f-b912-4d9b0918f3af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:02.091577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:02.092107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.098798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.099281 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.099718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.100487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.100975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.101402 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.115968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 HTTP/1.1 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:02.117512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.119068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4'} Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:02.119935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.121157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.122391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:02.122391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-113499cb-1d01-4a6b-beb2-bb6195a05fbd tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 404 len: 111 microversion: 2.1 time: 0.030947 Sep 19 14:59:02.122391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 706/816] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:02 2022] DELETE /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:02.127200 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:02.127802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.133728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.134206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.134641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.135348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.135795 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.136239 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.149956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 HTTP/1.1 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:02.151525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.153115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4'} Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:02.153996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. Sep 19 14:59:02.155436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:02.156789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance 8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:02.156789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8aa83bef-9557-42f4-b336-4256d4ea2976 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4" status: 404 len: 111 microversion: 2.1 time: 0.029525 Sep 19 14:59:02.156789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 707/817] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:02 2022] GET /compute/v2.1/servers/8f1a8d77-c5ac-4c7e-933c-8cd11f2fd0a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:02.359077 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:02.359703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:02.366871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.367353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.367793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.368517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:02.368974 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:02.369420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:02.508168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:02.516158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ae9c8640-d2ef-4e57-aaaf-66c4e6ab077b tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.161271 Sep 19 14:59:02.516723 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 708/818] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:02 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:03.292195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:03.292708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:03.299285 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.299765 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.300234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.300927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.301379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.301806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.316441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b HTTP/1.1 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:03.318069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.319644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'df1f4045-79b2-43d2-b1c4-e0a77d7d338b'} Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:03.320664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.322236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.323793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:03.323793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a58e2434-726c-418c-81f2-9077c9468b83 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 404 len: 111 microversion: 2.1 time: 0.031182 Sep 19 14:59:03.323793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 709/819] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:03 2022] DELETE /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:03.328791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:03.329403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] [instance: df1f4045-79b2-43d2-b1c4-e0a77d7d338b] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:03.335182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.335660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.336120 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.336822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.337265 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.337691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.351418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] HTTP exception thrown: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Request method failure captured: Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b HTTP/1.1 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKII24Y03eXEms4mY8e2Z0NvtfQ4b6pa8OzooGdbkEKM7JdgYgbtOwI85NQP0dpXMUa-BHt98fCtB0VydS4AKHA7y2yL4P2BmjQOaPp9Gs4q4LtpKID9ZmAOl8PLMUfHOLXMvxgNxwweAKrRO0k5M2BIoTIy6EAgaktORlfgwTMrj-O4 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:03.352983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b89056beeba940128ec6ff72b0c55b34", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b89056beeba940128ec6ff72b0c55b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: b89056beeba940128ec6ff72b0c55b34 Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-578655430 Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 61743a63def7451d9b739f3b17afe8b8 Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeNegativeTest-578655430-project Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.354578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'df1f4045-79b2-43d2-b1c4-e0a77d7d338b'} Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:03.355638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. Sep 19 14:59:03.357153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:03.358568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] Returning 404 to user: Instance df1f4045-79b2-43d2-b1c4-e0a77d7d338b could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:03.358568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-68ae27c7-ade0-4d12-937e-ddde078c74c1 tempest-AttachVolumeNegativeTest-578655430 tempest-AttachVolumeNegativeTest-578655430-project] 10.222.0.60 "GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b" status: 404 len: 111 microversion: 2.1 time: 0.029136 Sep 19 14:59:03.358568 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 710/820] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:03 2022] GET /compute/v2.1/servers/df1f4045-79b2-43d2-b1c4-e0a77d7d338b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:03.539288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:03.540597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:03.548512 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.548900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.549357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.550079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.550706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.551142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.783609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:03.791411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5271c43c-be5f-4713-b22c-b87c569532b4 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.256211 Sep 19 14:59:03.792009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 711/821] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:03 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:03.796684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-99bb4baf-69f2-4e3b-aaad-ee115a5d8286 req-f8075622-cdc5-42a9-bb36-bf2bfe9f343d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b2c21d-ef12-47b1-8ac7-43a6eb30d996", "name": "network-vif-plugged", "status": "completed", "tag": "e9e7dc81-3f4f-4517-bb50-4f763916413d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:03.806222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-99bb4baf-69f2-4e3b-aaad-ee115a5d8286 req-f8075622-cdc5-42a9-bb36-bf2bfe9f343d service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:03.806711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-99bb4baf-69f2-4e3b-aaad-ee115a5d8286 req-f8075622-cdc5-42a9-bb36-bf2bfe9f343d service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:03.807397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-99bb4baf-69f2-4e3b-aaad-ee115a5d8286 req-f8075622-cdc5-42a9-bb36-bf2bfe9f343d service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:03.818797 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-99bb4baf-69f2-4e3b-aaad-ee115a5d8286 req-f8075622-cdc5-42a9-bb36-bf2bfe9f343d service nova] Creating event network-vif-plugged:e9e7dc81-3f4f-4517-bb50-4f763916413d for instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 on hv-cinder-75670 Sep 19 14:59:03.823806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-99bb4baf-69f2-4e3b-aaad-ee115a5d8286 req-f8075622-cdc5-42a9-bb36-bf2bfe9f343d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030653 Sep 19 14:59:03.824446 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 712/822] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:04.815348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:04.816063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:04.822405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:04.822963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:04.823411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:04.824138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:04.824591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:04.825025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:05.013294 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:05.022314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ff25a4c3-377c-429e-9622-9710ded56d4d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1265 microversion: 2.1 time: 0.211902 Sep 19 14:59:05.023272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 713/823] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:04 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:06.047440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:06.048184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:06.056458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.056927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.057700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.058614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.059151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.059619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.247719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.255809 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-14a0f566-302e-4a95-811c-71502d1e94b9 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1453 microversion: 2.1 time: 0.213315 Sep 19 14:59:06.256419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 714/824] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:06 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:06.281514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:06.282649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:06.288750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.289243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.289686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.290386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:06.290841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:06.291275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:06.426490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:06.434592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5ab8e41b-02d1-4c2a-a134-54c99b04976a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1453 microversion: 2.1 time: 0.156937 Sep 19 14:59:06.435155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 715/825] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:06 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:07.921461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-463cde78-4c39-4bc2-8e39-5052f96d4b55 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Action: 'create', calling method: .version_select at 0x7f9f39a8b040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-700107607", "metadata": {"Type": "work"}}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-463cde78-4c39-4bc2-8e39-5052f96d4b55 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Request method failure captured: Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 121 Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIO7BDg1JyjzSuuP5tzDj_3hAwvJ_PjdsIjhKyV1lRoCZS1b6RfCJeeLWifT4DEsdqV0X41VG32xg66WvsVFc-LQhlTG_XzCwHc88yo7JVbcdfCSxIP_6zyru5O4Daohd7YZRQ1wsjnGQbNat6HHMDwkyLOvLfvVidv6a7HgVaouLYU Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:07.933901 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_886ca546827a4efbb3812111508ea460", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/886ca546827a4efbb3812111508ea460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 25f3eefbe0324a1fadf73453c655d85c Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-700107607", "metadata": {"Type": "work"}}} Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:59:07.935522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-700107607', 'metadata': {'Type': 'work'}}}} Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:07.936709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:59:07.938597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:59:07.940106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 14:59:07.940106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.940106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-463cde78-4c39-4bc2-8e39-5052f96d4b55 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:07.940106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-463cde78-4c39-4bc2-8e39-5052f96d4b55 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134610 Sep 19 14:59:07.942671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 716/826] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Sep 19 14:59:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:59:07.951660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ae483690-c996-48c8-8795-0d80a6800e6a tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Action: 'create', calling method: .version_select at 0x7f9f3d1a0ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2008205482", "metadata": {"Type": "work"}}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ae483690-c996-48c8-8795-0d80a6800e6a tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Request method failure captured: Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 120 Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIO7BDg1JyjzSuuP5tzDj_3hAwvJ_PjdsIjhKyV1lRoCZS1b6RfCJeeLWifT4DEsdqV0X41VG32xg66WvsVFc-LQhlTG_XzCwHc88yo7JVbcdfCSxIP_6zyru5O4Daohd7YZRQ1wsjnGQbNat6HHMDwkyLOvLfvVidv6a7HgVaouLYU Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:07.955814 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_886ca546827a4efbb3812111508ea460", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/886ca546827a4efbb3812111508ea460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 25f3eefbe0324a1fadf73453c655d85c Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2008205482", "metadata": {"Type": "work"}}} Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:59:07.957405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2008205482', 'metadata': {'Type': 'work'}}}} Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi '0' Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:07.958458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:59:07.960731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:59:07.962632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 14:59:07.962632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.962632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ae483690-c996-48c8-8795-0d80a6800e6a tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:07.962632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ae483690-c996-48c8-8795-0d80a6800e6a tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009407 Sep 19 14:59:07.962632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 717/827] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Sep 19 14:59:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:59:07.967574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-140f0098-e681-41ca-a0c2-f4ed52e8522d tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Action: 'create', calling method: .version_select at 0x7f9f3d1a01f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-524845659", "metadata": {"Type": "work"}}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-140f0098-e681-41ca-a0c2-f4ed52e8522d tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Request method failure captured: Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 118 Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIO7BDg1JyjzSuuP5tzDj_3hAwvJ_PjdsIjhKyV1lRoCZS1b6RfCJeeLWifT4DEsdqV0X41VG32xg66WvsVFc-LQhlTG_XzCwHc88yo7JVbcdfCSxIP_6zyru5O4Daohd7YZRQ1wsjnGQbNat6HHMDwkyLOvLfvVidv6a7HgVaouLYU Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:07.971660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_886ca546827a4efbb3812111508ea460", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/886ca546827a4efbb3812111508ea460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 25f3eefbe0324a1fadf73453c655d85c Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-524845659", "metadata": {"Type": "work"}}} Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:59:07.973810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-524845659', 'metadata': {'Type': 'work'}}}} Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise error Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi '' Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:07.975465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 14:59:07.977039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 14:59:07.978395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 14:59:07.978395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:07.978395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-140f0098-e681-41ca-a0c2-f4ed52e8522d tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:07.978395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-140f0098-e681-41ca-a0c2-f4ed52e8522d tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009156 Sep 19 14:59:07.978395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 718/828] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Sep 19 14:59:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:59:07.982690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad346440-bfc0-4525-8dd8-fbc2d8e1d0d9 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Calling method '.version_select at 0x7f9f399ab040>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:08.011125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-ad346440-bfc0-4525-8dd8-fbc2d8e1d0d9 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] HTTP exception thrown: Volume tempest-invalid-1179813724 could not be found. Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad346440-bfc0-4525-8dd8-fbc2d8e1d0d9 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Request method failure captured: Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1179813724 HTTP/1.1 Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIO7BDg1JyjzSuuP5tzDj_3hAwvJ_PjdsIjhKyV1lRoCZS1b6RfCJeeLWifT4DEsdqV0X41VG32xg66WvsVFc-LQhlTG_XzCwHc88yo7JVbcdfCSxIP_6zyru5O4Daohd7YZRQ1wsjnGQbNat6HHMDwkyLOvLfvVidv6a7HgVaouLYU Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:08.013111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_886ca546827a4efbb3812111508ea460", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/886ca546827a4efbb3812111508ea460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 25f3eefbe0324a1fadf73453c655d85c Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume tempest-invalid-1179813724 could not be found. Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'tempest-invalid-1179813724'} Sep 19 14:59:08.014747 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1179813724 could not be found. (HTTP 404) (Request-ID: req-d506078f-8468-46bb-b8b5-5b3891957c80) Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.016900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:59:08.018186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1179813724 could not be found. Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:08.019460 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1179813724 could not be found. Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1179813724 could not be found. Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad346440-bfc0-4525-8dd8-fbc2d8e1d0d9 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Returning 404 to user: Volume tempest-invalid-1179813724 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ad346440-bfc0-4525-8dd8-fbc2d8e1d0d9 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1179813724" status: 404 len: 99 microversion: 2.1 time: 0.035574 Sep 19 14:59:08.020825 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 719/829] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Sep 19 14:59:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1179813724 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 14:59:08.027256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1f397449-d624-44cb-abf2-e1103449977f tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003718 Sep 19 14:59:08.027756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 720/830] 10.222.0.60 () {58 vars in 1140 bytes} [Mon Sep 19 14:59:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 14:59:08.036382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e286fa5e-7e2b-4c84-ab36-b142ed624e45 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003513 Sep 19 14:59:08.036881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 721/831] 10.222.0.60 () {58 vars in 1137 bytes} [Mon Sep 19 14:59:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 19 14:59:08.045351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-87ac00f8-515a-46db-a6d8-19ab2b9e9a72 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Calling method '.version_select at 0x7f9f39a8bdc0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:08.078733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-87ac00f8-515a-46db-a6d8-19ab2b9e9a72 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] HTTP exception thrown: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-87ac00f8-515a-46db-a6d8-19ab2b9e9a72 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Request method failure captured: Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/os-volumes/eede37b3-b975-4e31-8a0b-5d1f5a250ca1 HTTP/1.1 Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIO7BDg1JyjzSuuP5tzDj_3hAwvJ_PjdsIjhKyV1lRoCZS1b6RfCJeeLWifT4DEsdqV0X41VG32xg66WvsVFc-LQhlTG_XzCwHc88yo7JVbcdfCSxIP_6zyru5O4Daohd7YZRQ1wsjnGQbNat6HHMDwkyLOvLfvVidv6a7HgVaouLYU Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:08.081288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_886ca546827a4efbb3812111508ea460", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/886ca546827a4efbb3812111508ea460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 25f3eefbe0324a1fadf73453c655d85c Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'eede37b3-b975-4e31-8a0b-5d1f5a250ca1'} Sep 19 14:59:08.082991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. (HTTP 404) (Request-ID: req-1f6758f3-4ab7-4cb8-9094-b50ed24cecb7) Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.083965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 14:59:08.085405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 14:59:08.086775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-87ac00f8-515a-46db-a6d8-19ab2b9e9a72 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Returning 404 to user: Volume eede37b3-b975-4e31-8a0b-5d1f5a250ca1 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-87ac00f8-515a-46db-a6d8-19ab2b9e9a72 tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/eede37b3-b975-4e31-8a0b-5d1f5a250ca1" status: 404 len: 109 microversion: 2.1 time: 0.041183 Sep 19 14:59:08.088570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 722/832] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:59:08 2022] DELETE /compute/v2.1/os-volumes/eede37b3-b975-4e31-8a0b-5d1f5a250ca1 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:08.092026 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6dfb7d6c-fa77-47d4-a4fa-4ac2f81b07ff tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Calling method '.version_select at 0x7f9f3d1a09d0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:08.122149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-6dfb7d6c-fa77-47d4-a4fa-4ac2f81b07ff tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] HTTP exception thrown: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6dfb7d6c-fa77-47d4-a4fa-4ac2f81b07ff tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Request method failure captured: Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/os-volumes/a0756426-863e-4b81-820f-d1a8787636af HTTP/1.1 Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIO7BDg1JyjzSuuP5tzDj_3hAwvJ_PjdsIjhKyV1lRoCZS1b6RfCJeeLWifT4DEsdqV0X41VG32xg66WvsVFc-LQhlTG_XzCwHc88yo7JVbcdfCSxIP_6zyru5O4Daohd7YZRQ1wsjnGQbNat6HHMDwkyLOvLfvVidv6a7HgVaouLYU Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:08.124143 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_886ca546827a4efbb3812111508ea460", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/886ca546827a4efbb3812111508ea460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/886ca546827a4efbb3812111508ea460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 886ca546827a4efbb3812111508ea460 Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesNegativeTest-1211832315 Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 25f3eefbe0324a1fadf73453c655d85c Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesNegativeTest-1211832315-project Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'a0756426-863e-4b81-820f-d1a8787636af'} Sep 19 14:59:08.126278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. (HTTP 404) (Request-ID: req-a94e0cf3-d0f4-4c28-8beb-7ccb82b19f0a) Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.127303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 14:59:08.128600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 14:59:08.129865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6dfb7d6c-fa77-47d4-a4fa-4ac2f81b07ff tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] Returning 404 to user: Volume a0756426-863e-4b81-820f-d1a8787636af could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6dfb7d6c-fa77-47d4-a4fa-4ac2f81b07ff tempest-VolumesNegativeTest-1211832315 tempest-VolumesNegativeTest-1211832315-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a0756426-863e-4b81-820f-d1a8787636af" status: 404 len: 109 microversion: 2.1 time: 0.037149 Sep 19 14:59:08.131183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 723/833] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:59:08 2022] GET /compute/v2.1/os-volumes/a0756426-863e-4b81-820f-d1a8787636af => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 14:59:08.423997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-16f46a81-6a3e-4cd3-90ba-939cb750c74b req-bb1ffc86-c2b2-45d4-9a7b-6a2c66f32116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b2c21d-ef12-47b1-8ac7-43a6eb30d996", "tag": "e9e7dc81-3f4f-4517-bb50-4f763916413d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:08.433718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-16f46a81-6a3e-4cd3-90ba-939cb750c74b req-bb1ffc86-c2b2-45d4-9a7b-6a2c66f32116 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:08.434198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-16f46a81-6a3e-4cd3-90ba-939cb750c74b req-bb1ffc86-c2b2-45d4-9a7b-6a2c66f32116 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:08.434634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-16f46a81-6a3e-4cd3-90ba-939cb750c74b req-bb1ffc86-c2b2-45d4-9a7b-6a2c66f32116 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:08.446227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-16f46a81-6a3e-4cd3-90ba-939cb750c74b req-bb1ffc86-c2b2-45d4-9a7b-6a2c66f32116 service nova] Creating event network-changed:e9e7dc81-3f4f-4517-bb50-4f763916413d for instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 on hv-cinder-75670 Sep 19 14:59:08.451258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-16f46a81-6a3e-4cd3-90ba-939cb750c74b req-bb1ffc86-c2b2-45d4-9a7b-6a2c66f32116 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Sep 19 14:59:08.451890 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 724/834] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:10.967042 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 14:59:10.967677 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 14:59:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 14:59:21.089642 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 14:59:21.090367 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 14:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 14:59:25.584060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:25.584789 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=91 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:25.748255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:25.748860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:25.755138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.755653 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.756246 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.756820 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:25.757273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:25.757721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:25.780997 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a141c1ae-bd3b-44f3-950c-bc2fcd43641e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/ips" status: 200 len: 147 microversion: 2.1 time: 0.203001 Sep 19 14:59:25.782170 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 725/835] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Sep 19 14:59:25 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/ips => generated 147 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:27.116886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52e584d3-c578-41f8-9609-3e329db3270f"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:27.119313 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:27.126348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.126822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.127255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.127959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.128405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.128821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.370403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-78ff3048-56f1-488f-8029-b5bac87a2b8c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257224 Sep 19 14:59:27.371017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 726/836] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:59:27 2022] POST /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:27.621067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:27.623238 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:27.630396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.630976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.632241 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.633111 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.633581 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.634182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.670125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b67fea2a-a207-4c36-a685-3b4a5c476a27 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053519 Sep 19 14:59:27.670685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 727/837] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Sep 19 14:59:27 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:27.814880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:27.815439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:27.825167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.825721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.826188 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.826950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.827398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.827868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.857385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:27.949166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c3a3473a-9db4-4148-8237-04dca24d9c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 204 len: 0 microversion: 2.20 time: 0.138513 Sep 19 14:59:27.949963 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 728/838] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Sep 19 14:59:27 2022] DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 14:59:27.959520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:27.960486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:27.967073 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.967601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.968122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:27.968878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:27.969331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:27.969758 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:28.105672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.114628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.116122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:28.117292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2cc2bcb7-a280-4f4d-9286-22f89e7ccdad tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.162329 Sep 19 14:59:28.117848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 729/839] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:27 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:59:29.145063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:29.145756 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:29.152033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.152522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.153017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.153754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:29.154203 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:29.154628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:29.290624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:29.298767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:29.300258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:29.301409 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dcfffe53-9393-4420-b7c4-976dbb5ba6b8 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1723 microversion: 2.20 time: 0.160898 Sep 19 14:59:29.301957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 730/840] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:29 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:59:30.326807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:30.327316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:30.338305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:30.339388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:30.340053 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:30.340938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:30.341560 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:30.342155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:30.423134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:30.437989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:30.439641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2c40600d2fd4eea8e4ba999050abd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db03071b1326441bb9571432be926bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:30.440887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d3682655-c6fb-4b74-a801-ff6af4195c58 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 200 len: 1655 microversion: 2.20 time: 0.118122 Sep 19 14:59:30.447273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 731/841] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:30 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 1655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 14:59:30.452768 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-f99a2b68-c86f-4342-83f5-43f73cd067cd req-caed4739-d04d-4c98-962d-15365f6f17e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415dd25c-7c9f-4db5-b8ea-fac7016eda48", "name": "network-vif-deleted", "tag": "274e690b-1c6b-4790-9dc2-5dbe545e77ae"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:30.471648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f99a2b68-c86f-4342-83f5-43f73cd067cd req-caed4739-d04d-4c98-962d-15365f6f17e6 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:30.472412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f99a2b68-c86f-4342-83f5-43f73cd067cd req-caed4739-d04d-4c98-962d-15365f6f17e6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:30.472839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f99a2b68-c86f-4342-83f5-43f73cd067cd req-caed4739-d04d-4c98-962d-15365f6f17e6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:30.486398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-f99a2b68-c86f-4342-83f5-43f73cd067cd req-caed4739-d04d-4c98-962d-15365f6f17e6 service nova] Creating event network-vif-deleted:274e690b-1c6b-4790-9dc2-5dbe545e77ae for instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 on hv-cinder-75670 Sep 19 14:59:30.496178 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-f99a2b68-c86f-4342-83f5-43f73cd067cd req-caed4739-d04d-4c98-962d-15365f6f17e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044090 Sep 19 14:59:30.496827 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 732/842] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:31.481975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:31.482686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:31.490158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:31.490652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:31.491095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:31.491878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:31.492299 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:31.492702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:31.507775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] HTTP exception thrown: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Request method failure captured: Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 HTTP/1.1 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIt3HdfmD0GWFHDLwkkL4efYDM8eunK6mORqOVuUIvSbIwo5ebxzFwMU997ngUCz8sPYpGAQ3xNfOp8OEtcsnWus7fxZbxk9Xwyjo_fHeKMT2ja8chmqVXrJImrXR5t0sNEMnua6UWhjPluxezsvCQqXv2pwMnVdFINshjk-6-9ULE Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:31.509750 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db03071b1326441bb9571432be926bf5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db03071b1326441bb9571432be926bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: b2c40600d2fd4eea8e4ba999050abd73 Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:31.511277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '415dd25c-7c9f-4db5-b8ea-fac7016eda48'} Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:31.512486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:31.513838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:31.515070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Returning 404 to user: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:31.515070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d01b26c7-92e5-4f8a-a30d-df0c05f6a4bb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 404 len: 111 microversion: 2.20 time: 0.037230 Sep 19 14:59:31.515070 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 733/843] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:31 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:59:31.523647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-34bfc26c-1cfd-4c5f-91dd-d183003c7c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '.version_select at 0x7f9f3d133040>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:31.559519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-34bfc26c-1cfd-4c5f-91dd-d183003c7c65 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-183801970" status: 204 len: 0 microversion: 2.20 time: 0.040847 Sep 19 14:59:31.560981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 734/844] 10.222.0.60 () {60 vars in 1259 bytes} [Mon Sep 19 14:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-183801970 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 14:59:32.420633 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 14:59:32.422337 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 14:59:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 14:59:33.719357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:33.719885 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:33.726514 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:33.727001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:33.727441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.728166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:33.728624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:33.729052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.744319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] HTTP exception thrown: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Request method failure captured: Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 HTTP/1.1 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIt3HdfmD0GWFHDLwkkL4efYDM8eunK6mORqOVuUIvSbIwo5ebxzFwMU997ngUCz8sPYpGAQ3xNfOp8OEtcsnWus7fxZbxk9Xwyjo_fHeKMT2ja8chmqVXrJImrXR5t0sNEMnua6UWhjPluxezsvCQqXv2pwMnVdFINshjk-6-9ULE Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:33.745910 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db03071b1326441bb9571432be926bf5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db03071b1326441bb9571432be926bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: b2c40600d2fd4eea8e4ba999050abd73 Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.747586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '415dd25c-7c9f-4db5-b8ea-fac7016eda48'} Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:33.748556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.750698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.752323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Returning 404 to user: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:33.752323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e5c40292-974f-450f-bd39-ecd9faa49191 tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 404 len: 111 microversion: 2.20 time: 0.032444 Sep 19 14:59:33.752323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 735/845] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Sep 19 14:59:33 2022] DELETE /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:59:33.756059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:33.756680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 415dd25c-7c9f-4db5-b8ea-fac7016eda48] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:33.762420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:33.762903 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:33.763341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.764064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:33.764522 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:33.764949 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:33.782174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] HTTP exception thrown: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Request method failure captured: Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 HTTP/1.1 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIt3HdfmD0GWFHDLwkkL4efYDM8eunK6mORqOVuUIvSbIwo5ebxzFwMU997ngUCz8sPYpGAQ3xNfOp8OEtcsnWus7fxZbxk9Xwyjo_fHeKMT2ja8chmqVXrJImrXR5t0sNEMnua6UWhjPluxezsvCQqXv2pwMnVdFINshjk-6-9ULE Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:33.783865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db03071b1326441bb9571432be926bf5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db03071b1326441bb9571432be926bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: b2c40600d2fd4eea8e4ba999050abd73 Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.785599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '415dd25c-7c9f-4db5-b8ea-fac7016eda48'} Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:33.786513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. Sep 19 14:59:33.788009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:33.789964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Returning 404 to user: Instance 415dd25c-7c9f-4db5-b8ea-fac7016eda48 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:33.789964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a9d82c90-a1c7-4a73-9f71-d5eb7c52a7cb tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48" status: 404 len: 111 microversion: 2.20 time: 0.032809 Sep 19 14:59:33.789964 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 736/846] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:33 2022] GET /compute/v2.1/servers/415dd25c-7c9f-4db5-b8ea-fac7016eda48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 14:59:34.978273 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:34.980652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:34.990012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:34.990791 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:34.991226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:34.991946 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:34.992396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:34.992923 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.029079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3b8d665c-f24a-4c67-8c95-83fcd8cf69c5 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055907 Sep 19 14:59:35.029836 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 737/847] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:59:34 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:35.035058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:35.035587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:35.041437 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:35.041810 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:35.042249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.043114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:35.043609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:35.044040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.058092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] HTTP exception thrown: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Request method failure captured: Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 HTTP/1.1 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIt3HdfmD0GWFHDLwkkL4efYDM8eunK6mORqOVuUIvSbIwo5ebxzFwMU997ngUCz8sPYpGAQ3xNfOp8OEtcsnWus7fxZbxk9Xwyjo_fHeKMT2ja8chmqVXrJImrXR5t0sNEMnua6UWhjPluxezsvCQqXv2pwMnVdFINshjk-6-9ULE Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:35.059671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db03071b1326441bb9571432be926bf5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db03071b1326441bb9571432be926bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: b2c40600d2fd4eea8e4ba999050abd73 Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.061392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '7c86857b-a653-4c5f-97c0-643793ca4d35'} Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:35.062222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.065046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.066975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Returning 404 to user: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:35.066975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-85e17163-962f-4907-a72b-2b493b90771b tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 404 len: 111 microversion: 2.20 time: 0.030154 Sep 19 14:59:35.066975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 738/848] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Sep 19 14:59:35 2022] DELETE /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:59:35.066975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:35.067341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:35.075909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:35.075909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:35.075909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.075909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:35.076360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:35.076360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.106673 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6c1efb59-e285-4121-8e29-4b4e6053bab4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/52e584d3-c578-41f8-9609-3e329db3270f" status: 200 len: 194 microversion: 2.1 time: 0.043964 Sep 19 14:59:35.107259 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 739/849] 10.222.0.60 () {58 vars in 1413 bytes} [Mon Sep 19 14:59:35 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/52e584d3-c578-41f8-9609-3e329db3270f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:35.112632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:35.113233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] [instance: 7c86857b-a653-4c5f-97c0-643793ca4d35] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:35.119090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:35.119528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:35.120001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.120709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:35.121162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:35.121591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:35.136154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] HTTP exception thrown: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Request method failure captured: Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 HTTP/1.1 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIIt3HdfmD0GWFHDLwkkL4efYDM8eunK6mORqOVuUIvSbIwo5ebxzFwMU997ngUCz8sPYpGAQ3xNfOp8OEtcsnWus7fxZbxk9Xwyjo_fHeKMT2ja8chmqVXrJImrXR5t0sNEMnua6UWhjPluxezsvCQqXv2pwMnVdFINshjk-6-9ULE Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:35.137760 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_db03071b1326441bb9571432be926bf5", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/db03071b1326441bb9571432be926bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/db03071b1326441bb9571432be926bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: db03071b1326441bb9571432be926bf5 Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-151812304 Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: b2c40600d2fd4eea8e4ba999050abd73 Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-151812304-project Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.139405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '7c86857b-a653-4c5f-97c0-643793ca4d35'} Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:35.140588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. Sep 19 14:59:35.142109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:35.143589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] Returning 404 to user: Instance 7c86857b-a653-4c5f-97c0-643793ca4d35 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:35.143589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ed165ca3-440c-44a4-9ae3-329938b4623d tempest-AttachVolumeShelveTestJSON-151812304 tempest-AttachVolumeShelveTestJSON-151812304-project] 10.222.0.60 "GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35" status: 404 len: 111 microversion: 2.20 time: 0.030967 Sep 19 14:59:35.143589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 740/850] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Sep 19 14:59:35 2022] GET /compute/v2.1/servers/7c86857b-a653-4c5f-97c0-643793ca4d35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 14:59:36.608556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "148db6a1-4971-481a-bad9-ae4835ea32e9"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:36.610882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:36.617734 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:36.618212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:36.618639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:36.619333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:36.619782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:36.620228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:36.897912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-243ef944-63cf-4a4c-80a0-9e54a2a6514d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "POST /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292957 Sep 19 14:59:36.898575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 741/851] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 14:59:36 2022] POST /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:40.936636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-138b5f78-2f3b-4541-adb7-af8dd29dc4de tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f39b52ee0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:40.983074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-138b5f78-2f3b-4541-adb7-af8dd29dc4de tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f409447e-0edc-48e9-9c45-0eb01b3906b2" status: 200 len: 351 microversion: 2.1 time: 0.051472 Sep 19 14:59:40.983678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 742/852] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:59:40 2022] GET /compute/v2.1/os-volumes/f409447e-0edc-48e9-9c45-0eb01b3906b2 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:42.324971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5b6166c5-5b70-424b-8d88-4277cfc4cedd tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f39a8bdc0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:42.371395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5b6166c5-5b70-424b-8d88-4277cfc4cedd tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6df6cc94-2fcf-4d64-8d1d-57fe8c126638" status: 200 len: 351 microversion: 2.1 time: 0.050609 Sep 19 14:59:42.372032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 743/853] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:59:42 2022] GET /compute/v2.1/os-volumes/6df6cc94-2fcf-4d64-8d1d-57fe8c126638 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:43.471062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:43.474084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:43.482001 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.482496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.482937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.484198 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.484663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.485100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.505647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:43.525265 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-50832627-0f53-4d61-8704-2bd3c702060e tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059988 Sep 19 14:59:43.525830 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 744/854] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:59:43 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:43.669372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:43.669876 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:43.676406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.676896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.677341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.678043 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.678633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.679066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.713638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c2b43b06-99d2-4fdb-a79b-67ab86b4b720 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/52e584d3-c578-41f8-9609-3e329db3270f" status: 200 len: 194 microversion: 2.1 time: 0.048773 Sep 19 14:59:43.714253 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 745/855] 10.222.0.60 () {58 vars in 1413 bytes} [Mon Sep 19 14:59:43 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/52e584d3-c578-41f8-9609-3e329db3270f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:43.722011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b1ed2787-03a7-426e-9989-224b0579ef8b tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f3d1a03a0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:43.771464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b1ed2787-03a7-426e-9989-224b0579ef8b tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4b22ac3d-a082-454a-a9f1-1fc0b24abbc3" status: 200 len: 351 microversion: 2.1 time: 0.054467 Sep 19 14:59:43.772179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 746/856] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Sep 19 14:59:43 2022] GET /compute/v2.1/os-volumes/4b22ac3d-a082-454a-a9f1-1fc0b24abbc3 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:43.777076 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:43.777570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:43.785348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.785835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.786262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.786954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:43.787405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:43.787919 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:43.879958 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lazy-loading 'services' on Instance uuid c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:59:43.964698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-68cd7086-f982-40f3-842f-8808f5a8f9ec tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/52e584d3-c578-41f8-9609-3e329db3270f" status: 202 len: 0 microversion: 2.1 time: 0.190891 Sep 19 14:59:43.965420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 747/857] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:59:43 2022] DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/52e584d3-c578-41f8-9609-3e329db3270f => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:43.983083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-41f6925a-e976-48db-b457-f661d00be673 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f39a8bee0>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.091860 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-41f6925a-e976-48db-b457-f661d00be673 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.124370 Sep 19 14:59:44.092619 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 748/858] 10.222.0.60 () {58 vars in 1134 bytes} [Mon Sep 19 14:59:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:44.106733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dfbfdc04-c648-43b1-8d58-d592309b1577 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f39a88820>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.199218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dfbfdc04-c648-43b1-8d58-d592309b1577 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096229 Sep 19 14:59:44.200030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 749/859] 10.222.0.60 () {58 vars in 1149 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:44.214206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7e9344bc-c3e6-4294-8707-1abdf2b2da6e tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f3998da60>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.297452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7e9344bc-c3e6-4294-8707-1abdf2b2da6e tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087019 Sep 19 14:59:44.298023 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 750/860] 10.222.0.60 () {58 vars in 1134 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:44.312989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-999fe2a2-6e6f-42b8-b886-4fad08bebc6b tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f3d179b80>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.413231 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-999fe2a2-6e6f-42b8-b886-4fad08bebc6b tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104624 Sep 19 14:59:44.413822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 751/861] 10.222.0.60 () {58 vars in 1167 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:44.433251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f9ff1c4d-71e1-4d9e-8c3a-9f495bcc241a tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f3d142550>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.518189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f9ff1c4d-71e1-4d9e-8c3a-9f495bcc241a tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089007 Sep 19 14:59:44.518938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 752/862] 10.222.0.60 () {58 vars in 1170 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:44.534007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c6a4790d-0335-47e1-864e-249ad81c8cdb tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f3d142f70>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.623145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c6a4790d-0335-47e1-864e-249ad81c8cdb tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.093349 Sep 19 14:59:44.623728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 753/863] 10.222.0.60 () {58 vars in 1155 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:44.638327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0e0ff901-7df0-42d7-87c0-fa219ec4f4f2 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f3d179310>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.738657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0e0ff901-7df0-42d7-87c0-fa219ec4f4f2 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104199 Sep 19 14:59:44.748082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 754/864] 10.222.0.60 () {58 vars in 1188 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:44.756063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f3c8a2a4-72ba-4af4-aba3-a932c29c45a3 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] Calling method '.version_select at 0x7f9f399cbd30>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:44.846957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f3c8a2a4-72ba-4af4-aba3-a932c29c45a3 tempest-VolumesTestJSON-2088091600 tempest-VolumesTestJSON-2088091600-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.096767 Sep 19 14:59:44.847754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 755/865] 10.222.0.60 () {58 vars in 1155 bytes} [Mon Sep 19 14:59:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:45.121926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:45.122627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:45.130225 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.130739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.131204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.132245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.132822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.133418 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.167707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6e182b40-9de2-4e14-9501-584ec71d20c0 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/148db6a1-4971-481a-bad9-ae4835ea32e9" status: 200 len: 194 microversion: 2.1 time: 0.051589 Sep 19 14:59:45.168528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 756/866] 10.222.0.60 () {58 vars in 1413 bytes} [Mon Sep 19 14:59:45 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/148db6a1-4971-481a-bad9-ae4835ea32e9 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:45.179891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:45.180316 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:45.187561 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.188088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.188527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.189223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:45.189678 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:45.190099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:45.285284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lazy-loading 'services' on Instance uuid c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 14:59:45.362888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-aa100a6e-6f4a-44dc-a233-9cfc796bc7e6 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/148db6a1-4971-481a-bad9-ae4835ea32e9" status: 202 len: 0 microversion: 2.1 time: 0.187339 Sep 19 14:59:45.363497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 757/867] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 14:59:45 2022] DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments/148db6a1-4971-481a-bad9-ae4835ea32e9 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 14:59:46.561365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:46.564935 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:46.571767 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.573051 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.573665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.574684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.575320 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.576185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.613488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ca71bfaf-c1a1-49cf-a396-4ef2bd830f03 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057216 Sep 19 14:59:46.614171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 758/868] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:59:46 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 14:59:46.733007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:46.735709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:46.742029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.742518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.742960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.743655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.744142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.744569 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.773387 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-86cdf07b-5ae5-4b5a-9b35-430885e6d41d tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044302 Sep 19 14:59:46.773943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 759/869] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 14:59:46 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 14:59:46.840884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:46.841382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:46.847746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.848335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.848874 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.849648 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.850165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.850639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.876333 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 14:59:46.950998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-662929f7-b6bd-4fdb-89bc-16e8143dec3c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 204 len: 0 microversion: 2.1 time: 0.114731 Sep 19 14:59:46.951590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 760/870] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:46 2022] DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 14:59:46.962399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:46.963099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:46.969364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.969851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.970288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:46.971015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:46.971470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:46.971922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:47.109369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:47.117078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2dae66bb-4d01-497e-b24e-97157236615c tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1674 microversion: 2.1 time: 0.160710 Sep 19 14:59:47.117641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 761/871] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:46 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:47.710822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-59429056", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "networks": [{"uuid": "a19bb939-a8a6-428a-875d-0f5a63708114"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:47.767432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] validate_networks() for [('a19bb939-a8a6-428a-875d-0f5a63708114', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 14:59:48.117908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 14:59:48.118351 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 14:59:48.118823 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 14:59:48.119403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 14:59:48.119886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 14:59:48.128899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.129399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.129883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.130608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.131055 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.131476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.148573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Getting quotas for project 4502d9a0ff3a414f855bf0beb35ffd35. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 14:59:48.152547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Getting quotas for user 0edc61e9f06e47e69fad8ba5e2a7f201 and project 4502d9a0ff3a414f855bf0beb35ffd35. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 14:59:48.163871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 14:59:48.166142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 14:59:48.211788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-080b3b26-0daf-46d3-a0c8-745d2c044119 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504980 Sep 19 14:59:48.212453 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 762/872] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 14:59:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 14:59:48.219152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:48.219152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:48.224353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.224835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.225377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.226072 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:48.226521 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:48.226940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:48.368045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:48.377998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-45351701-07b7-4d9f-b13a-65d4a83d161b tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1674 microversion: 2.1 time: 0.164440 Sep 19 14:59:48.378649 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 763/873] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:48 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:48.383549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-82eefc4f-640d-443b-948d-4bca518efec7 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:48.384190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-82eefc4f-640d-443b-948d-4bca518efec7 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:48.442319 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-82eefc4f-640d-443b-948d-4bca518efec7 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:48.449191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-82eefc4f-640d-443b-948d-4bca518efec7 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1212 microversion: 2.1 time: 0.069384 Sep 19 14:59:48.449754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 764/874] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:48 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:49.404915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:49.406588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:49.415105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:49.416481 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:49.419486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:49.422209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:49.424205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:49.428991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:49.948177 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ef9d62f31d4135b6f079a26d791ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a431be4c2f247e2955883eab6a5f555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:49.958588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1504136b-d128-42a0-a0b6-41642b1b3f35 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 200 len: 1674 microversion: 2.1 time: 0.559512 Sep 19 14:59:49.959548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 765/875] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:49 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 1674 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:49.964618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:49.965452 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:49.972151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:49.972893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:49.973519 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:49.974425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:49.975075 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:49.976020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.062652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:50.073335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ae998ee3-d7d1-4592-ace3-414b0565899b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1270 microversion: 2.1 time: 0.111956 Sep 19 14:59:50.074204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 766/876] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:49 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:50.322458 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-caacdb36-c822-4a98-ab0a-ab7bc4ecaa4e req-163386d7-6dd2-4ddb-8720-3605e4d8d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2", "name": "network-vif-deleted", "tag": "2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:50.358878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-caacdb36-c822-4a98-ab0a-ab7bc4ecaa4e req-163386d7-6dd2-4ddb-8720-3605e4d8d069 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:50.360377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-caacdb36-c822-4a98-ab0a-ab7bc4ecaa4e req-163386d7-6dd2-4ddb-8720-3605e4d8d069 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:50.361032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-caacdb36-c822-4a98-ab0a-ab7bc4ecaa4e req-163386d7-6dd2-4ddb-8720-3605e4d8d069 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:50.377040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-caacdb36-c822-4a98-ab0a-ab7bc4ecaa4e req-163386d7-6dd2-4ddb-8720-3605e4d8d069 service nova] Creating event network-vif-deleted:2dfa0e4d-fa8b-4a1a-a1b7-6d5257e84978 for instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 on hv-cinder-75670 Sep 19 14:59:50.382898 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-caacdb36-c822-4a98-ab0a-ab7bc4ecaa4e req-163386d7-6dd2-4ddb-8720-3605e4d8d069 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064783 Sep 19 14:59:50.383597 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 767/877] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 14:59:50.983705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:50.984782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:50.998762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.000140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.000745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.001763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.002426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.003019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.020438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] HTTP exception thrown: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Request method failure captured: Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 HTTP/1.1 Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKMGqk5Gb9qGTs4K2omk0zzNoD8qZrlLyBuuSpgu5aiHPr8i0RHQlgJg-Lv4RNCqBXD1LSryW5dgR_ptdRZMSyYqq7GmnCgfa5g9Yhnw3gqCziqieNJ1vY6VvbBpWFSR-Gs9LRKGsg2S5ECvk2xyojIm38fsVV3_BiYfPkF1Ona43g Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:51.023293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a431be4c2f247e2955883eab6a5f555", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 73ef9d62f31d4135b6f079a26d791ca5 Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:51.025296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2'} Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:51.026268 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:51.027957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:51.037002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Returning 404 to user: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:51.038084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3c985029-3cb7-4db1-a4bb-9ca59e68ea0f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 404 len: 111 microversion: 2.1 time: 0.059033 Sep 19 14:59:51.039880 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 768/878] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:50 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:51.049421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-da20a71d-f3c1-453a-9e9c-5c20041aa06a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '.version_select at 0x7f9f3d133f70>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:51.066549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:51.088543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-da20a71d-f3c1-453a-9e9c-5c20041aa06a tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362106299" status: 202 len: 0 microversion: 2.1 time: 0.044822 Sep 19 14:59:51.093473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 769/879] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Sep 19 14:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362106299 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 14:59:51.103248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:51.104248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:51.113217 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.113926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.114574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.115497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:51.116386 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:51.117035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:51.377504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:51.388701 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-74655ea1-3b8c-4cf3-b456-71fa35acb40f tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.291192 Sep 19 14:59:51.389361 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 770/880] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:51 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:52.403708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-6fb999b3-b6d8-4ebb-aae7-126f6e9db359 req-0e4084ff-88a8-4237-993c-7085c98cd43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594f85be-a56a-4dec-b12a-db701114ecd6", "tag": "00b82e31-c05c-4631-b4ba-757b388ded8a"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:52.415959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6fb999b3-b6d8-4ebb-aae7-126f6e9db359 req-0e4084ff-88a8-4237-993c-7085c98cd43f service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.416752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6fb999b3-b6d8-4ebb-aae7-126f6e9db359 req-0e4084ff-88a8-4237-993c-7085c98cd43f service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.417504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6fb999b3-b6d8-4ebb-aae7-126f6e9db359 req-0e4084ff-88a8-4237-993c-7085c98cd43f service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.425392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:52.437227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-6fb999b3-b6d8-4ebb-aae7-126f6e9db359 req-0e4084ff-88a8-4237-993c-7085c98cd43f service nova] Creating event network-changed:00b82e31-c05c-4631-b4ba-757b388ded8a for instance 594f85be-a56a-4dec-b12a-db701114ecd6 on hv-cinder-75670 Sep 19 14:59:52.442119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-6fb999b3-b6d8-4ebb-aae7-126f6e9db359 req-0e4084ff-88a8-4237-993c-7085c98cd43f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042068 Sep 19 14:59:52.442939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 771/881] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:52.448398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:52.449086 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:52.455553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.456061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.456492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.457185 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:52.457620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:52.458040 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:52.599872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:52.607573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-986f1a70-8fcf-4358-975e-25c99712f297 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.163339 Sep 19 14:59:52.608154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 772/882] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:52 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:53.631193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:53.631875 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:53.639212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.640064 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.640574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.641403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:53.641957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:53.642513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:53.779317 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:53.787556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-23e4f937-104d-4791-a41e-9aa76ddd1d4a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.160223 Sep 19 14:59:53.788148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 773/883] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:53 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:54.246325 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:54.246882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:54.252886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.253380 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.253865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.254642 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.255147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.255709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.269518 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] HTTP exception thrown: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Request method failure captured: Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 HTTP/1.1 Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKMGqk5Gb9qGTs4K2omk0zzNoD8qZrlLyBuuSpgu5aiHPr8i0RHQlgJg-Lv4RNCqBXD1LSryW5dgR_ptdRZMSyYqq7GmnCgfa5g9Yhnw3gqCziqieNJ1vY6VvbBpWFSR-Gs9LRKGsg2S5ECvk2xyojIm38fsVV3_BiYfPkF1Ona43g Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:54.271208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a431be4c2f247e2955883eab6a5f555", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 73ef9d62f31d4135b6f079a26d791ca5 Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.272931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2'} Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:54.273887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.275509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.277057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Returning 404 to user: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:54.277057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0fccb462-858d-453e-8612-8ab19e4a8d02 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 404 len: 111 microversion: 2.1 time: 0.030435 Sep 19 14:59:54.277057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 774/884] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:54 2022] DELETE /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:54.281220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:54.281828 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:54.287621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.288127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.288603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.289293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.289751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.290204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.303250 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] HTTP exception thrown: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Request method failure captured: Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 HTTP/1.1 Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKMGqk5Gb9qGTs4K2omk0zzNoD8qZrlLyBuuSpgu5aiHPr8i0RHQlgJg-Lv4RNCqBXD1LSryW5dgR_ptdRZMSyYqq7GmnCgfa5g9Yhnw3gqCziqieNJ1vY6VvbBpWFSR-Gs9LRKGsg2S5ECvk2xyojIm38fsVV3_BiYfPkF1Ona43g Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:54.304793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a431be4c2f247e2955883eab6a5f555", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 73ef9d62f31d4135b6f079a26d791ca5 Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.306371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2'} Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:54.307588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. Sep 19 14:59:54.309130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:54.310654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Returning 404 to user: Instance c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:54.310654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d85144e4-8d9e-457d-b887-b00970f76b2f tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2" status: 404 len: 111 microversion: 2.1 time: 0.029082 Sep 19 14:59:54.310654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 775/885] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:54 2022] GET /compute/v2.1/servers/c40c2e55-ebc1-4f3d-b516-6eddf9cde3b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:54.810867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:54.812081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:54.818531 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.819124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.819547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.820262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:54.820704 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:54.821122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:54.959461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:54.967151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2a8acd9a-c54f-4e6c-b585-34cf50171b9d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.160482 Sep 19 14:59:54.967712 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 776/886] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:54 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:55.455463 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:55.455994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:55.461975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.462454 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.462883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.463583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.464061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.464534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.481088 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] HTTP exception thrown: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Request method failure captured: Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 HTTP/1.1 Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKMGqk5Gb9qGTs4K2omk0zzNoD8qZrlLyBuuSpgu5aiHPr8i0RHQlgJg-Lv4RNCqBXD1LSryW5dgR_ptdRZMSyYqq7GmnCgfa5g9Yhnw3gqCziqieNJ1vY6VvbBpWFSR-Gs9LRKGsg2S5ECvk2xyojIm38fsVV3_BiYfPkF1Ona43g Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:55.482643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a431be4c2f247e2955883eab6a5f555", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 73ef9d62f31d4135b6f079a26d791ca5 Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.484979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'f41656a6-4409-4e9a-9b29-066443ea6426'} Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:55.485932 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.487480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.490300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Returning 404 to user: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:55.490300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-811f3e27-c449-4f51-937f-149b1cd4d2f4 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 404 len: 111 microversion: 2.1 time: 0.034078 Sep 19 14:59:55.490300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 777/887] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 14:59:55 2022] DELETE /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:55.493146 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:55.493778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] [instance: f41656a6-4409-4e9a-9b29-066443ea6426] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:55.499708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.500297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.500772 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.501468 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:55.501920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:55.502429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:55.517007 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] HTTP exception thrown: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Request method failure captured: Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 HTTP/1.1 Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIKMGqk5Gb9qGTs4K2omk0zzNoD8qZrlLyBuuSpgu5aiHPr8i0RHQlgJg-Lv4RNCqBXD1LSryW5dgR_ptdRZMSyYqq7GmnCgfa5g9Yhnw3gqCziqieNJ1vY6VvbBpWFSR-Gs9LRKGsg2S5ECvk2xyojIm38fsVV3_BiYfPkF1Ona43g Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 14:59:55.518567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a431be4c2f247e2955883eab6a5f555", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a431be4c2f247e2955883eab6a5f555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 9a431be4c2f247e2955883eab6a5f555 Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-483262191 Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 73ef9d62f31d4135b6f079a26d791ca5 Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-AttachVolumeTestJSON-483262191-project Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.520150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'f41656a6-4409-4e9a-9b29-066443ea6426'} Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 14:59:55.520943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. Sep 19 14:59:55.522179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 14:59:55.523359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] Returning 404 to user: Instance f41656a6-4409-4e9a-9b29-066443ea6426 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 14:59:55.523359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-1977669f-9186-47e5-9457-37d5ddfe2519 tempest-AttachVolumeTestJSON-483262191 tempest-AttachVolumeTestJSON-483262191-project] 10.222.0.60 "GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426" status: 404 len: 111 microversion: 2.1 time: 0.030704 Sep 19 14:59:55.523359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 778/888] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:55 2022] GET /compute/v2.1/servers/f41656a6-4409-4e9a-9b29-066443ea6426 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 14:59:55.991539 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:55.992212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:56.001761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:56.002262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:56.002699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:56.004313 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:56.004779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:56.005205 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:56.157538 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:56.165542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9b6592b8-b0e8-4981-b53b-30cfb7bf8367 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.178874 Sep 19 14:59:56.166127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 779/889] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:55 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:57.190010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:57.190761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:57.202248 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.202752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.203195 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:57.203929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.204388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.204842 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:57.347503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:57.374618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-602b03e2-a3ed-45ff-bf25-1e13f0e0c931 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.186438 Sep 19 14:59:57.374618 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 780/890] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:57 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 14:59:57.865771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-b9adfef4-d17e-4d63-83c5-bc8c5116f526 req-583f6e2a-a0eb-4a83-9379-4ef35e07a0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594f85be-a56a-4dec-b12a-db701114ecd6", "name": "network-vif-plugged", "status": "completed", "tag": "00b82e31-c05c-4631-b4ba-757b388ded8a"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 14:59:57.879035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-b9adfef4-d17e-4d63-83c5-bc8c5116f526 req-583f6e2a-a0eb-4a83-9379-4ef35e07a0c6 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:57.879934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-b9adfef4-d17e-4d63-83c5-bc8c5116f526 req-583f6e2a-a0eb-4a83-9379-4ef35e07a0c6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:57.880582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-b9adfef4-d17e-4d63-83c5-bc8c5116f526 req-583f6e2a-a0eb-4a83-9379-4ef35e07a0c6 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:57.894374 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-b9adfef4-d17e-4d63-83c5-bc8c5116f526 req-583f6e2a-a0eb-4a83-9379-4ef35e07a0c6 service nova] Creating event network-vif-plugged:00b82e31-c05c-4631-b4ba-757b388ded8a for instance 594f85be-a56a-4dec-b12a-db701114ecd6 on hv-cinder-75670 Sep 19 14:59:57.899424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-b9adfef4-d17e-4d63-83c5-bc8c5116f526 req-583f6e2a-a0eb-4a83-9379-4ef35e07a0c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037427 Sep 19 14:59:57.900233 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 781/891] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 14:59:58.403186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:58.403988 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:58.406526 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:58.413595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:58.414154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:58.414658 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:58.415497 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:58.416878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:58.416878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:58.447638 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=8 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 14:59:58.690682 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:58.698330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0cd6a7d1-e472-43d3-aab3-8da630fb30c6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.299369 Sep 19 14:59:58.698889 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 782/892] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:58 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 14:59:59.725390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 14:59:59.726009 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 14:59:59.733975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.734464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.734893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.735589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 14:59:59.736082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 14:59:59.736506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 14:59:59.887367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 14:59:59.896121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-992273aa-10a0-40bb-bfaf-1ee1b23b8525 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1312 microversion: 2.1 time: 0.174641 Sep 19 14:59:59.896699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 783/893] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 14:59:59 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:00.919887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:00.921110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:00.930287 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.931060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.931805 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:00.932779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:00.933240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:00.937390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.080749 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:01.088828 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-80db9443-bc78-4ae5-ad29-192069f31f72 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1495 microversion: 2.1 time: 0.172832 Sep 19 15:00:01.089732 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 784/894] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:00 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1495 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:01.580456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:01.580944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:01.587628 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.588314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.589083 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.589955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.590547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.591034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.619995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:00:01.715277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4056a883-985d-4cdf-9e3f-88ce8229a468 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "DELETE /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 204 len: 0 microversion: 2.1 time: 0.138971 Sep 19 15:00:01.716545 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 785/895] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 15:00:01 2022] DELETE /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:00:01.725066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:01.725966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:01.732443 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.733556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.734114 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.734892 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:01.735604 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:01.736259 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:01.875559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:01.883595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d674cee7-945d-4424-9e57-801d85debe0c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1501 microversion: 2.1 time: 0.162564 Sep 19 15:00:01.884207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 786/896] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:01 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:02.909084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:02.910553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:02.917644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:02.918171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:02.918839 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:02.919911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:02.920424 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:02.920994 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:03.062878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:03.070623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b90229d5-9893-4a2b-ae41-8bceb4fe3785 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1501 microversion: 2.1 time: 0.166716 Sep 19 15:00:03.071193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 787/897] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:02 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:03.692274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-2ffdf4d6-d4e1-4e40-b15b-4caf713ff812 req-5c258147-242b-4555-965f-1d633b5148c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594f85be-a56a-4dec-b12a-db701114ecd6", "name": "network-vif-deleted", "tag": "00b82e31-c05c-4631-b4ba-757b388ded8a"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:03.704720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2ffdf4d6-d4e1-4e40-b15b-4caf713ff812 req-5c258147-242b-4555-965f-1d633b5148c0 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:03.705128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2ffdf4d6-d4e1-4e40-b15b-4caf713ff812 req-5c258147-242b-4555-965f-1d633b5148c0 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:03.705561 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-2ffdf4d6-d4e1-4e40-b15b-4caf713ff812 req-5c258147-242b-4555-965f-1d633b5148c0 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:03.717260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-2ffdf4d6-d4e1-4e40-b15b-4caf713ff812 req-5c258147-242b-4555-965f-1d633b5148c0 service nova] Creating event network-vif-deleted:00b82e31-c05c-4631-b4ba-757b388ded8a for instance 594f85be-a56a-4dec-b12a-db701114ecd6 on hv-cinder-75670 Sep 19 15:00:03.723108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-2ffdf4d6-d4e1-4e40-b15b-4caf713ff812 req-5c258147-242b-4555-965f-1d633b5148c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034584 Sep 19 15:00:03.723775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 788/898] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:04.096417 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:04.097115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:04.103684 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:04.104261 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:04.104983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:04.105286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:04.105731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:04.106144 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:04.148444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:04.148800 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:04.149338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:04.149699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lazy-loading 'fault' on Instance uuid 594f85be-a56a-4dec-b12a-db701114ecd6 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:00:04.204421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:04.213365 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a131dd67-63d1-428c-819b-a9dc78de366e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 200 len: 1302 microversion: 2.1 time: 0.121019 Sep 19 15:00:04.214447 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 789/899] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:04 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:05.239608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:05.240309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: 594f85be-a56a-4dec-b12a-db701114ecd6] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:05.246590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.247045 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.247472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.248171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.248686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.249104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.262101 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] HTTP exception thrown: Instance 594f85be-a56a-4dec-b12a-db701114ecd6 could not be found. Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Request method failure captured: Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 HTTP/1.1 Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIPhw44TOZ7UD3GgbZ97egdkU3rnm2SN_zWXyV5slhvG_d9jxYQ6mc4pRM8Lx5zvrsC0zDYX5JvVXhTQRcJi2aH5ihNoNwULkzm_I3Mub4QUYQRDddkeBxmjPbFiSojx4kPdMcT0DxUxxS2ltVvtUDMgJNixyCKGbjxXGzR1xb54Wrg Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 4502d9a0ff3a414f855bf0beb35ffd35 Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesActionsTest-511379009 Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:00:05.263705 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4502d9a0ff3a414f855bf0beb35ffd35", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4502d9a0ff3a414f855bf0beb35ffd35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4502d9a0ff3a414f855bf0beb35ffd35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4502d9a0ff3a414f855bf0beb35ffd35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesActionsTest-511379009 Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 4502d9a0ff3a414f855bf0beb35ffd35 Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesActionsTest-511379009 Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesActionsTest-511379009-project Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 0edc61e9f06e47e69fad8ba5e2a7f201 Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesActionsTest-511379009-project Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 594f85be-a56a-4dec-b12a-db701114ecd6 could not be found. Sep 19 15:00:05.265352 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '594f85be-a56a-4dec-b12a-db701114ecd6'} Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594f85be-a56a-4dec-b12a-db701114ecd6 could not be found. Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:00:05.266362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594f85be-a56a-4dec-b12a-db701114ecd6 could not be found. Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594f85be-a56a-4dec-b12a-db701114ecd6 could not be found. Sep 19 15:00:05.267914 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:05.269292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Returning 404 to user: Instance 594f85be-a56a-4dec-b12a-db701114ecd6 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:00:05.269292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-46e2d002-f2ed-4cf7-998f-638a2557e4ed tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6" status: 404 len: 111 microversion: 2.1 time: 0.029933 Sep 19 15:00:05.269292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 790/900] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:05 2022] GET /compute/v2.1/servers/594f85be-a56a-4dec-b12a-db701114ecd6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:00:05.364918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-445884933", "imageRef": "29903b7f-066d-4acd-8900-8feadfdf75ba", "flavorRef": "452", "networks": [{"uuid": "a19bb939-a8a6-428a-875d-0f5a63708114"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:05.416868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] validate_networks() for [('a19bb939-a8a6-428a-875d-0f5a63708114', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:00:05.765186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:00:05.765607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:00:05.766074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:00:05.766479 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:00:05.766886 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:00:05.775556 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.776038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.776473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.777183 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:05.777626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:05.778044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:05.785277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:05.798588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Getting quotas for project 4502d9a0ff3a414f855bf0beb35ffd35. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:00:05.802520 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Getting quotas for user 0edc61e9f06e47e69fad8ba5e2a7f201 and project 4502d9a0ff3a414f855bf0beb35ffd35. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:00:05.814020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:00:05.816296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29903b7f-066d-4acd-8900-8feadfdf75ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:00:05.863042 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a2eeebf0-9600-476a-9595-f408258aecf1 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501901 Sep 19 15:00:05.863978 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 791/901] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 15:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:00:05.881225 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ad4742f7-6d19-4b8e-b8b0-2e873a63933c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:05.881225 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ad4742f7-6d19-4b8e-b8b0-2e873a63933c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:05.936533 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ad4742f7-6d19-4b8e-b8b0-2e873a63933c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:05.943991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ad4742f7-6d19-4b8e-b8b0-2e873a63933c tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1213 microversion: 2.1 time: 0.067922 Sep 19 15:00:05.944779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 792/902] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:05 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:06.966275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:06.966888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:06.973459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:06.973941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:06.974382 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:06.975071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:06.975527 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:06.975976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:07.035928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:07.043405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-737c07ed-c3e2-45cb-9eff-8eedad911945 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1217 microversion: 2.1 time: 0.080939 Sep 19 15:00:07.043981 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 793/903] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:06 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:08.067590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:08.068270 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:08.079158 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:08.079651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:08.080292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:08.081140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:08.081659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:08.082176 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:08.162922 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:08.171148 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6ae59570-50da-4e25-b5f9-0444a36be26b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1271 microversion: 2.1 time: 0.106877 Sep 19 15:00:08.171710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 794/904] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:08 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:09.194627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:09.195355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:09.202162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:09.202717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:09.203652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:09.204018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:09.204500 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:09.205031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:09.414796 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:09.425841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f4de5d3a-2190-4251-bfcc-9b7d27423329 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.234957 Sep 19 15:00:09.426429 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 795/905] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:09 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:09.446826 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-3a3a80fe-1b06-40a2-86ec-47fb4cc6f9e7 req-20076504-fdc1-4176-9d1d-5ed63575ec80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ada142-ba57-4086-afc3-63bdadc82e59", "tag": "0887ce30-17a7-4f4b-9afa-acb712e8df73"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:09.456331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-3a3a80fe-1b06-40a2-86ec-47fb4cc6f9e7 req-20076504-fdc1-4176-9d1d-5ed63575ec80 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:09.456893 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-3a3a80fe-1b06-40a2-86ec-47fb4cc6f9e7 req-20076504-fdc1-4176-9d1d-5ed63575ec80 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:09.457249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-3a3a80fe-1b06-40a2-86ec-47fb4cc6f9e7 req-20076504-fdc1-4176-9d1d-5ed63575ec80 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:09.469191 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-3a3a80fe-1b06-40a2-86ec-47fb4cc6f9e7 req-20076504-fdc1-4176-9d1d-5ed63575ec80 service nova] Creating event network-changed:0887ce30-17a7-4f4b-9afa-acb712e8df73 for instance b6ada142-ba57-4086-afc3-63bdadc82e59 on hv-cinder-75670 Sep 19 15:00:09.474017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-3a3a80fe-1b06-40a2-86ec-47fb4cc6f9e7 req-20076504-fdc1-4176-9d1d-5ed63575ec80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030758 Sep 19 15:00:09.474635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 796/906] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:00:10.450704 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:10.451430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:10.457580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:10.458062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:10.458498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:10.459187 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:10.459646 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:10.460095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:10.595228 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:10.603559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-632fd069-79dd-48ba-9408-da21c2788505 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.157470 Sep 19 15:00:10.604300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 797/907] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:10 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:11.627763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:11.628417 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:11.635318 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:11.635891 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:11.636331 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:11.637035 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:11.637502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:11.637920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:11.772097 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:11.780367 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ce58ce0a-16ce-4f91-9ff0-13b779ef5769 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.156609 Sep 19 15:00:11.780991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 798/908] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:11 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:12.804058 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:12.804748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:12.812469 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:12.813031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:12.813464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:12.814160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:12.814617 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:12.815039 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:12.962110 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:12.970355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-380c3d34-7f75-48cd-bbad-bcf1fef11d5b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.170151 Sep 19 15:00:12.970950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 799/909] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:12 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:13.994307 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:13.994948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:14.001854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:14.002179 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:14.002474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:14.003166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:14.003614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:14.004052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:14.192348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:14.202047 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-7b54185a-7617-45e9-937a-9f84f5d551cf tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.211929 Sep 19 15:00:14.202626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 800/910] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:13 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:15.227019 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:15.227663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:15.234471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:15.234954 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:15.235421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:15.236152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:15.236605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:15.237028 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:15.384752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:15.393897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ff522a4b-ad57-47c9-a3b2-a20efd505b0e tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.170671 Sep 19 15:00:15.394741 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 801/911] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:15 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:15.742976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-1f3b1971-826d-47aa-939d-8cb18110c5a8 req-60153b32-4b7d-40e7-a1b6-64dfa55544a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ada142-ba57-4086-afc3-63bdadc82e59", "name": "network-vif-plugged", "status": "completed", "tag": "0887ce30-17a7-4f4b-9afa-acb712e8df73"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:15.759603 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1f3b1971-826d-47aa-939d-8cb18110c5a8 req-60153b32-4b7d-40e7-a1b6-64dfa55544a7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:15.760118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1f3b1971-826d-47aa-939d-8cb18110c5a8 req-60153b32-4b7d-40e7-a1b6-64dfa55544a7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:15.760557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-1f3b1971-826d-47aa-939d-8cb18110c5a8 req-60153b32-4b7d-40e7-a1b6-64dfa55544a7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:15.784691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-1f3b1971-826d-47aa-939d-8cb18110c5a8 req-60153b32-4b7d-40e7-a1b6-64dfa55544a7 service nova] Creating event network-vif-plugged:0887ce30-17a7-4f4b-9afa-acb712e8df73 for instance b6ada142-ba57-4086-afc3-63bdadc82e59 on hv-cinder-75670 Sep 19 15:00:15.789149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:15.791726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-1f3b1971-826d-47aa-939d-8cb18110c5a8 req-60153b32-4b7d-40e7-a1b6-64dfa55544a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052763 Sep 19 15:00:15.792557 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 802/912] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:00:16.415772 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=8 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:16.420726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:16.421423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:16.428608 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:16.429107 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:16.429516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:16.430204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:16.430656 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:16.431337 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:16.561372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:16.569212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f8d9b95a-decb-4c79-8f3c-395652474b3a tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1313 microversion: 2.1 time: 0.154291 Sep 19 15:00:16.569779 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 803/913] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:16 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:17.592550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:17.593206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:17.600711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:17.601207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:17.601653 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:17.602359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:17.602847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:17.603274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:17.736987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:17.750509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4db5ee75-f5ec-4d6e-83c3-dcb6c417f150 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1497 microversion: 2.1 time: 0.161625 Sep 19 15:00:17.751504 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 804/914] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:17 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:18.222186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:18.222709 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:18.229030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:18.229517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:18.229956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:18.230670 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:18.231127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:18.231558 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:18.258303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:00:18.350212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:00:18.364590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bf3405e0-810a-4ebf-afb8-19b1c7929130 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 204 len: 0 microversion: 2.1 time: 0.146210 Sep 19 15:00:18.369099 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 805/915] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 15:00:18 2022] DELETE /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:00:18.375356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:18.376184 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:18.382748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:18.383242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:18.383711 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:18.384492 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:18.384916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:18.385335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:18.535763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:18.543729 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-34beed65-552f-49c4-ac4c-19d7ad572df6 tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1503 microversion: 2.1 time: 0.173110 Sep 19 15:00:18.544403 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 806/916] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:18 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:00:19.567505 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:19.568186 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:19.575745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:19.576400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:19.576835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:19.577534 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:19.577982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:19.578402 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:19.753124 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edc61e9f06e47e69fad8ba5e2a7f201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4502d9a0ff3a414f855bf0beb35ffd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:00:19.763049 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cd039b86-eb89-4dfa-8f5e-263523c29c3b tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 200 len: 1503 microversion: 2.1 time: 0.200196 Sep 19 15:00:19.764207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 807/917] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:19 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:00:20.153630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-21656d13-f740-4e63-98db-313aaee54018 req-180c95e6-827a-406b-af3c-39775170806b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ada142-ba57-4086-afc3-63bdadc82e59", "name": "network-vif-deleted", "tag": "0887ce30-17a7-4f4b-9afa-acb712e8df73"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:00:20.164928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-21656d13-f740-4e63-98db-313aaee54018 req-180c95e6-827a-406b-af3c-39775170806b service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.165566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-21656d13-f740-4e63-98db-313aaee54018 req-180c95e6-827a-406b-af3c-39775170806b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.166038 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-21656d13-f740-4e63-98db-313aaee54018 req-180c95e6-827a-406b-af3c-39775170806b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:20.178499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-21656d13-f740-4e63-98db-313aaee54018 req-180c95e6-827a-406b-af3c-39775170806b service nova] Creating event network-vif-deleted:0887ce30-17a7-4f4b-9afa-acb712e8df73 for instance b6ada142-ba57-4086-afc3-63bdadc82e59 on hv-cinder-75670 Sep 19 15:00:20.184602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-21656d13-f740-4e63-98db-313aaee54018 req-180c95e6-827a-406b-af3c-39775170806b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034545 Sep 19 15:00:20.188016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 808/918] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:00:20.789218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:00:20.789939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] [instance: b6ada142-ba57-4086-afc3-63bdadc82e59] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:00:20.797140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.797626 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.798057 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:20.798754 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:00:20.799207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:00:20.799634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:00:20.815393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] HTTP exception thrown: Instance b6ada142-ba57-4086-afc3-63bdadc82e59 could not be found. Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Request method failure captured: Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 HTTP/1.1 Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIPhw44TOZ7UD3GgbZ97egdkU3rnm2SN_zWXyV5slhvG_d9jxYQ6mc4pRM8Lx5zvrsC0zDYX5JvVXhTQRcJi2aH5ihNoNwULkzm_I3Mub4QUYQRDddkeBxmjPbFiSojx4kPdMcT0DxUxxS2ltVvtUDMgJNixyCKGbjxXGzR1xb54Wrg Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 4502d9a0ff3a414f855bf0beb35ffd35 Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-VolumesActionsTest-511379009 Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:00:20.817063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4502d9a0ff3a414f855bf0beb35ffd35", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4502d9a0ff3a414f855bf0beb35ffd35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4502d9a0ff3a414f855bf0beb35ffd35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4502d9a0ff3a414f855bf0beb35ffd35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-VolumesActionsTest-511379009 Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 4502d9a0ff3a414f855bf0beb35ffd35 Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-VolumesActionsTest-511379009 Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-VolumesActionsTest-511379009-project Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 0edc61e9f06e47e69fad8ba5e2a7f201 Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-VolumesActionsTest-511379009-project Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance b6ada142-ba57-4086-afc3-63bdadc82e59 could not be found. Sep 19 15:00:20.818879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'b6ada142-ba57-4086-afc3-63bdadc82e59'} Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ada142-ba57-4086-afc3-63bdadc82e59 could not be found. Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:00:20.820310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ada142-ba57-4086-afc3-63bdadc82e59 could not be found. Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ada142-ba57-4086-afc3-63bdadc82e59 could not be found. Sep 19 15:00:20.821967 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:00:20.823850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] Returning 404 to user: Instance b6ada142-ba57-4086-afc3-63bdadc82e59 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:00:20.823850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-01e5f9de-9fc4-4b61-b311-59b74743f24d tempest-VolumesActionsTest-511379009 tempest-VolumesActionsTest-511379009-project] 10.222.0.60 "GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59" status: 404 len: 111 microversion: 2.1 time: 0.035317 Sep 19 15:00:20.823850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 809/919] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:00:20 2022] GET /compute/v2.1/servers/b6ada142-ba57-4086-afc3-63bdadc82e59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:01:06.243132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-351573705", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-579270075", "security_groups": [{"name": "tempest-secgroup-smoke-591621420"}], "block_device_mapping_v2": [{"uuid": "3ebb00c5-9b8d-462c-a278-f9021da3ecda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2fec6bb0-9f94-43d5-b3e5-a726dd57258c"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:06.253988 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=9 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:06.254627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:06.367488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] validate_networks() for [('2fec6bb0-9f94-43d5-b3e5-a726dd57258c', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:01:06.759193 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:01:06.759616 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:01:06.760126 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:01:06.760532 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:01:06.760937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:01:06.770235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.770719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.771157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.771921 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:06.772411 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:06.772835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:06.791818 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:01:06.796379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Getting quotas for user 52173f24f42a481380b047abe76bca57 and project cbb13ea6de2a48e99ce93be06fd87830. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:01:06.854400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:01:06.856591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ebb00c5-9b8d-462c-a278-f9021da3ecda',volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:01:06.991783 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-91c4b92c-d47a-47be-842d-e0ad8b76dc99 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753048 Sep 19 15:01:06.992620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 810/920] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 15:01:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:01:07.003849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a41d8258-8a10-49e2-b859-03eeabbb59d7 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:07.004467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a41d8258-8a10-49e2-b859-03eeabbb59d7 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:07.069222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a41d8258-8a10-49e2-b859-03eeabbb59d7 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:07.076223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a41d8258-8a10-49e2-b859-03eeabbb59d7 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1093 microversion: 2.1 time: 0.075997 Sep 19 15:01:07.077172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 811/921] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:06 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:08.098659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:08.100216 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:08.108372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.108906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.109385 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:08.110486 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:08.111113 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:08.111726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:08.204142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:08.212141 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8629700c-e5b3-4440-b2c0-91738da1000e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1199 microversion: 2.1 time: 0.117353 Sep 19 15:01:08.212833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 812/922] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:08 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1199 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:09.237356 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:09.237956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:09.245766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.246251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.250644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.251728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.253252 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.254464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.492790 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:09.501443 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8bd66341-b5ed-411c-9337-f472920cf41a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.268224 Sep 19 15:01:09.502393 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 813/923] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:09 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:09.918724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-c7dd23a9-ee63-4236-84dd-534bc925dc91 req-0cd0d409-6d0d-4aba-bf26-02956c8506b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cd8058-1e91-4ff3-90c1-93bb8106ddb8", "tag": "d0cba83a-0c6d-4b60-9927-84d66ee146d6"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:09.934456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-c7dd23a9-ee63-4236-84dd-534bc925dc91 req-0cd0d409-6d0d-4aba-bf26-02956c8506b5 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:09.935813 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-c7dd23a9-ee63-4236-84dd-534bc925dc91 req-0cd0d409-6d0d-4aba-bf26-02956c8506b5 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:09.936477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-c7dd23a9-ee63-4236-84dd-534bc925dc91 req-0cd0d409-6d0d-4aba-bf26-02956c8506b5 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:09.952101 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-c7dd23a9-ee63-4236-84dd-534bc925dc91 req-0cd0d409-6d0d-4aba-bf26-02956c8506b5 service nova] Creating event network-changed:d0cba83a-0c6d-4b60-9927-84d66ee146d6 for instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 on hv-cinder-75670 Sep 19 15:01:09.958207 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-c7dd23a9-ee63-4236-84dd-534bc925dc91 req-0cd0d409-6d0d-4aba-bf26-02956c8506b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Sep 19 15:01:09.959448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 814/924] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:01:10.527584 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:10.528491 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:10.535699 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.536209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.536643 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.537339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:10.537784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:10.538202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:10.805866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:10.816267 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d9810646-90f5-401b-88a5-fe600784260e tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.294470 Sep 19 15:01:10.831341 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 815/925] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:10 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:11.840117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:11.840727 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:11.847480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:11.848182 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:11.848637 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:11.849663 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:11.850308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:11.850822 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:12.000004 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:12.008312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3b460ec1-25f0-4716-b4f6-01b97d12d177 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.172988 Sep 19 15:01:12.008896 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 816/926] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:11 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:13.033056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:13.033748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:13.040119 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.040601 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.041031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.041721 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:13.042165 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:13.042596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:13.180483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:13.188989 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8370e53e-f0b6-47e2-bfa9-c5c0ce143ecd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.160907 Sep 19 15:01:13.189567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 817/927] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:13 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:01:14.210987 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:14.211850 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:14.218471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:14.218959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:14.219405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:14.220314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:14.220780 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:14.221214 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:14.369257 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:14.379163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f2dd352b-259f-4de7-932a-8f7bdc384d56 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.172370 Sep 19 15:01:14.388559 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 818/928] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:14 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:15.402470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:15.403100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:15.411171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:15.412343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:15.412793 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:15.413503 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:15.414145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:15.414570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:15.567787 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:15.576094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8303d68a-09f9-4cad-9f37-3950265776d3 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.176871 Sep 19 15:01:15.576660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 819/929] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:15 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:16.601555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:16.603471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:16.611782 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.612296 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.612849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.613439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:16.613897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:16.614322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:16.757010 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:16.764718 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6ffc25c9-7a01-430d-bd92-92c46c4cf227 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.169297 Sep 19 15:01:16.765364 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 820/930] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:16 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:17.787928 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:17.788602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:17.790461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:17.791229 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=8 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:17.797644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.798128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.798566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.799265 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:17.799715 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:17.800167 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:17.943815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:17.952094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-299a6a76-816e-4493-aadb-1dec65fb6e7d tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.168046 Sep 19 15:01:17.952669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 821/931] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:17 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:18.974702 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:18.975389 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:18.982041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:18.982517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:18.982948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:18.983654 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:18.984130 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:18.984549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:19.129570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:19.137609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a2e37135-ea9c-42aa-a50d-7f4f569c05c1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.166778 Sep 19 15:01:19.138762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 822/932] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:18 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:20.160895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:20.161507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:20.173323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:20.173833 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:20.174339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:20.175108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:20.175788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:20.176282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:20.318513 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:20.326440 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4f534585-8db6-4a77-b001-df54ee32c17a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.169384 Sep 19 15:01:20.327016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 823/933] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:20 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:21.349408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:21.350074 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:21.356242 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.356736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.357180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.357884 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.358340 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.358769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.512012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:21.520774 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f1ce3d24-48ac-401f-915c-74bc15f34668 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.175143 Sep 19 15:01:21.535849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 824/934] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:21 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:21.569953 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-fdfd3705-1a9c-4cc7-b864-af632df7dbe2 req-55a17ec0-4d03-4edc-9cca-8d931537cabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cd8058-1e91-4ff3-90c1-93bb8106ddb8", "name": "network-vif-plugged", "status": "completed", "tag": "d0cba83a-0c6d-4b60-9927-84d66ee146d6"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:21.580871 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-fdfd3705-1a9c-4cc7-b864-af632df7dbe2 req-55a17ec0-4d03-4edc-9cca-8d931537cabc service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:21.581621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-fdfd3705-1a9c-4cc7-b864-af632df7dbe2 req-55a17ec0-4d03-4edc-9cca-8d931537cabc service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:21.582172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-fdfd3705-1a9c-4cc7-b864-af632df7dbe2 req-55a17ec0-4d03-4edc-9cca-8d931537cabc service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:21.595235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-fdfd3705-1a9c-4cc7-b864-af632df7dbe2 req-55a17ec0-4d03-4edc-9cca-8d931537cabc service nova] Creating event network-vif-plugged:d0cba83a-0c6d-4b60-9927-84d66ee146d6 for instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 on hv-cinder-75670 Sep 19 15:01:21.601152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-fdfd3705-1a9c-4cc7-b864-af632df7dbe2 req-55a17ec0-4d03-4edc-9cca-8d931537cabc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035748 Sep 19 15:01:21.602138 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 825/935] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:01:22.547161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:22.547911 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:22.554190 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:22.554685 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:22.555125 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:22.555835 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:22.556302 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:22.556751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:22.726285 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:22.735719 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0a925450-91e6-4ad0-a49d-e7c2e8ee23dd tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.194195 Sep 19 15:01:22.736359 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 826/936] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:22 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:23.759189 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:23.759937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:23.766801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:23.767289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:23.767730 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:23.768450 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:23.768908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:23.769339 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:23.902781 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:23.911433 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-cce2b8e7-6bf6-4fb6-9984-edcdb07dd023 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1264 microversion: 2.1 time: 0.156303 Sep 19 15:01:23.912046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 827/937] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:23 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:24.934587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:24.935235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:24.941652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:24.942137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:24.942570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:24.943262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:24.943714 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:24.944172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:25.081489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:25.089629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ff867cab-1ed0-45b6-a098-51d62dffcd55 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1452 microversion: 2.1 time: 0.159166 Sep 19 15:01:25.091223 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 828/938] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:24 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:25.112897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:01:25.113510 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:01:25.119726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:25.120247 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:25.120689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:25.121391 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:25.122031 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:25.122459 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:25.141441 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:01:25.253548 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:01:25.261272 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-228eee47-ed63-4bdf-95f8-3d25c5d63e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1452 microversion: 2.1 time: 0.152267 Sep 19 15:01:25.261848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 829/939] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:01:25 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:01:27.592651 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-8780806a-0821-41b0-8892-b6a25ed8a258 req-c8f3da8c-f5a3-4d6e-9298-92a0443b3379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cd8058-1e91-4ff3-90c1-93bb8106ddb8", "tag": "d0cba83a-0c6d-4b60-9927-84d66ee146d6"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:01:27.602999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8780806a-0821-41b0-8892-b6a25ed8a258 req-c8f3da8c-f5a3-4d6e-9298-92a0443b3379 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:01:27.604022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8780806a-0821-41b0-8892-b6a25ed8a258 req-c8f3da8c-f5a3-4d6e-9298-92a0443b3379 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:01:27.604602 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8780806a-0821-41b0-8892-b6a25ed8a258 req-c8f3da8c-f5a3-4d6e-9298-92a0443b3379 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:01:27.617622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-8780806a-0821-41b0-8892-b6a25ed8a258 req-c8f3da8c-f5a3-4d6e-9298-92a0443b3379 service nova] Creating event network-changed:d0cba83a-0c6d-4b60-9927-84d66ee146d6 for instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 on hv-cinder-75670 Sep 19 15:01:27.625480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-8780806a-0821-41b0-8892-b6a25ed8a258 req-c8f3da8c-f5a3-4d6e-9298-92a0443b3379 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230171 Sep 19 15:01:27.626990 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 830/940] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:07.113478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.114243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:07.118355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-aa800767-ccc7-4a1c-b487-dc80bdfc7213 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Action: 'create', calling method: .version_select at 0x7f9f3d104940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-775843559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEdZFX/bBpWVd/eBy3Pyhz3/G+XPrWO3aV4xZaq+kNBdFwDseLUhaa3Ja6XdFSaWJczAUH4m9l1o8AF0c0b1pqTcoMPkM/LFZZmud607JXlMdw6lMmmcSD1r3eAZu1vg=="}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:07.135334 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-aa800767-ccc7-4a1c-b487-dc80bdfc7213 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Getting quotas for project 5fca221e257f44dea6b74f7737978739. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:02:07.139474 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-aa800767-ccc7-4a1c-b487-dc80bdfc7213 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Getting quotas for user a3d7fd2980ce48a49931642b01bab212 and project 5fca221e257f44dea6b74f7737978739. Resources: {'key_pairs'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:02:07.161624 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-aa800767-ccc7-4a1c-b487-dc80bdfc7213 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049845 Sep 19 15:02:07.162206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 831/941] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Sep 19 15:02:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:07.212726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-426688934", "imageRef": "ffa25e6e-d98a-4495-9d4d-cfca8fac243b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-775843559", "networks": [{"uuid": "b731c688-9114-4409-a87b-c5ec513cda4c"}]}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:07.265353 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.network.neutron [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] validate_networks() for [('b731c688-9114-4409-a87b-c5ec513cda4c', None, None, None, None, None)] {{(pid=126870) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 15:02:07.634465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Flavor limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 15:02:07.634895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Image limits 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 15:02:07.635397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Flavor pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 15:02:07.635808 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Image pref 0:0:0 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 15:02:07.636931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.virt.hardware [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 15:02:07.645763 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:07.646249 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:07.646689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:07.647421 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:07.647900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:07.648336 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:07.665274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Getting quotas for project 5fca221e257f44dea6b74f7737978739. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 15:02:07.669210 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.quota [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Getting quotas for user a3d7fd2980ce48a49931642b01bab212 and project 5fca221e257f44dea6b74f7737978739. Resources: {'instances', 'ram', 'cores'} {{(pid=126870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 15:02:07.680044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Going to run 1 instances... {{(pid=126870) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 15:02:07.682432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ffa25e6e-d98a-4495-9d4d-cfca8fac243b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 15:02:07.728362 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d971f803-6b7f-45b7-951f-2e14468dc914 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519526 Sep 19 15:02:07.729015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 832/942] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Sep 19 15:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 15:02:07.740792 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b8ad93fd-3a99-4e21-85e6-c3a43b296473 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:07.741587 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b8ad93fd-3a99-4e21-85e6-c3a43b296473 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:07.798573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b8ad93fd-3a99-4e21-85e6-c3a43b296473 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:07.805676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b8ad93fd-3a99-4e21-85e6-c3a43b296473 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1257 microversion: 2.1 time: 0.068673 Sep 19 15:02:07.808870 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 833/943] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:07 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:08.829583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:08.831017 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:08.841122 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.841612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:08.842048 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:08.842752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:08.843202 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:08.843620 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:08.940432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:08.949571 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-598ac7dd-4e81-4fae-8c2b-5b1dcf552f7f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1317 microversion: 2.1 time: 0.123791 Sep 19 15:02:08.950275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 834/944] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:08 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1317 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:09.974005 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:09.974748 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:09.982713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.983204 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.983664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:09.984390 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:09.984848 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:09.985329 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:10.134590 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:10.143071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-38dc1357-27de-4523-a289-8bc662a7ee37 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.173226 Sep 19 15:02:10.143635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 835/945] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:09 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:11.168515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:11.169172 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:11.175803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.176434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.176909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.177464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:11.177920 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:11.178344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:11.325392 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:11.333237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4c18adbc-b32c-49c9-9212-8bca99f2fe4f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.169245 Sep 19 15:02:11.333801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 836/946] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:11 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:12.357117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:12.357837 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:12.364405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.364887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.365323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.366022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:12.366462 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:12.367162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:12.502888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:12.516573 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8f3dcc07-bad9-4fb7-9391-5bfd17daa02b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.163356 Sep 19 15:02:12.517173 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 837/947] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:12 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:13.541944 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:13.543430 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:13.550996 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.551881 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.552564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.553776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:13.554451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:13.555094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:13.702564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:13.710577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ded19f9a-957b-45bc-9b43-7dde56a7db73 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.172470 Sep 19 15:02:13.711147 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 838/948] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:13 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:14.734841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:14.736476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:14.744310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:14.744807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:14.745897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:14.746612 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:14.747289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:14.748033 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:14.890260 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:14.899255 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c0577a5e-aa61-4aad-875f-ef626b0ae9ba tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.168231 Sep 19 15:02:14.900078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 839/949] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:14 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:15.924580 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:15.926276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:15.933605 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:15.934472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:15.935161 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:15.936136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:15.936664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:15.937163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:16.354166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:16.366061 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d5870d7e-a0ab-483d-beb1-4131ac4402dd tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.445151 Sep 19 15:02:16.381444 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 840/950] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:15 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:17.390701 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:17.391381 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:17.397801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:17.398292 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:17.398731 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:17.399425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:17.399908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:17.400335 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:17.526788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:17.534589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-13ec9e35-225d-43ee-9f77-432d39d697d2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.147857 Sep 19 15:02:17.535153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 841/951] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:17 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:18.557419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:18.558350 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:18.560254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:18.561063 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=12 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:18.567079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:18.567611 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:18.568071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:18.568815 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:18.569212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:18.569629 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:18.810482 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:18.820127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3f590c47-743e-44e8-9c43-617f899b035d tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.266377 Sep 19 15:02:18.820775 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 842/952] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:18 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:18.947457 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-4966b6d1-ba61-40b1-93dc-26241b1f77fc req-6bf09a3c-62b1-4fb0-bec2-e53aac00d289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:18.959972 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4966b6d1-ba61-40b1-93dc-26241b1f77fc req-6bf09a3c-62b1-4fb0-bec2-e53aac00d289 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:18.960471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4966b6d1-ba61-40b1-93dc-26241b1f77fc req-6bf09a3c-62b1-4fb0-bec2-e53aac00d289 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:18.961082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-4966b6d1-ba61-40b1-93dc-26241b1f77fc req-6bf09a3c-62b1-4fb0-bec2-e53aac00d289 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:18.973029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-4966b6d1-ba61-40b1-93dc-26241b1f77fc req-6bf09a3c-62b1-4fb0-bec2-e53aac00d289 service nova] Creating event network-changed:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:02:18.977971 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-4966b6d1-ba61-40b1-93dc-26241b1f77fc req-6bf09a3c-62b1-4fb0-bec2-e53aac00d289 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034280 Sep 19 15:02:18.978576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 843/953] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:19.844625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:19.845322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:19.851635 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.852155 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.852594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.853284 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:19.853736 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:19.854162 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:19.979664 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:19.987694 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3d424cc6-e6ed-40b2-99f4-9759c90a9815 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.147903 Sep 19 15:02:19.988275 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 844/954] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:19 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:21.011197 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:21.011908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:21.018309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:21.018819 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:21.019234 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:21.019952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:21.020435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:21.020873 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:21.311639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:21.319245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-4532c4ec-a6cf-41f6-8df0-f7b0c59d2be4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.311974 Sep 19 15:02:21.319802 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 845/955] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:21 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:22.342744 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:22.343377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:22.349938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:22.350420 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:22.350854 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:22.351542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:22.352025 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:22.352461 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:22.480645 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:22.488745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-23fa6624-75b6-43f8-94b0-6b3124fe9ff2 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.149996 Sep 19 15:02:22.489310 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 846/956] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:22 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:23.512274 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:23.513537 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:23.519983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.520470 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.520908 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.521600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:23.522056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:23.522478 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:23.650066 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:23.657864 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ccb81ee4-8d91-4b54-b639-a3a8f457013a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.149573 Sep 19 15:02:23.658456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 847/957] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:23 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:24.681090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:24.681761 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:24.688680 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:24.689160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:24.689594 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:24.690288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:24.690742 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:24.691163 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:24.836308 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:24.844717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-97ebaad2-73a2-424d-b4fa-f52a09769316 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.167762 Sep 19 15:02:24.845300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 848/958] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:24 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:24.849769 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-5853fb66-8d7c-4c32-aead-8b6574996fc3 req-c45a4f19-50d0-43b2-a84f-bec8fa0fa026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "name": "network-vif-plugged", "status": "completed", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:24.859634 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5853fb66-8d7c-4c32-aead-8b6574996fc3 req-c45a4f19-50d0-43b2-a84f-bec8fa0fa026 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:24.860128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5853fb66-8d7c-4c32-aead-8b6574996fc3 req-c45a4f19-50d0-43b2-a84f-bec8fa0fa026 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:24.860561 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5853fb66-8d7c-4c32-aead-8b6574996fc3 req-c45a4f19-50d0-43b2-a84f-bec8fa0fa026 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:24.872015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-5853fb66-8d7c-4c32-aead-8b6574996fc3 req-c45a4f19-50d0-43b2-a84f-bec8fa0fa026 service nova] Creating event network-vif-plugged:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:02:24.877630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-5853fb66-8d7c-4c32-aead-8b6574996fc3 req-c45a4f19-50d0-43b2-a84f-bec8fa0fa026 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031197 Sep 19 15:02:24.878236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 849/959] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:25.870156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:25.870863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:25.877131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.877627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.878068 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:25.878771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:25.879290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:25.879659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:26.011762 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:26.019927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-373f0a94-546a-4d2b-8cbc-bff6e16e85fb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1357 microversion: 2.1 time: 0.154472 Sep 19 15:02:26.020490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 850/960] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:25 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:27.042690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:27.043398 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:27.050394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.050879 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.051321 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.052121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.052583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.053008 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.073508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=100 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:27.198524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:27.206934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-c5859e8a-737e-47ba-8a17-2be6f323861e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1547 microversion: 2.1 time: 0.168085 Sep 19 15:02:27.207717 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 851/961] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:27 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:27.230439 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:27.231085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:27.237109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.237630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.238093 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.238806 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.239278 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.239708 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.365196 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:27.373369 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8457238e-a500-4472-811b-6ee92f8d37b6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1547 microversion: 2.1 time: 0.146783 Sep 19 15:02:27.373929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 852/962] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:27 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:27.394956 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:27.399707 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:27.400498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Searching by: {'deleted': False, 'project_id': '5fca221e257f44dea6b74f7737978739'} {{(pid=126870) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 15:02:27.407044 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.407515 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.407980 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.408698 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.409151 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.409570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.497037 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.multi_cell_list [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126870) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 15:02:27.745975 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-0328efd8-39af-4ce6-a9de-0265a4dd7164 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.354487 Sep 19 15:02:27.746553 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 853/963] 10.222.0.60 () {58 vars in 1125 bytes} [Mon Sep 19 15:02:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:27.759476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:27.760102 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:27.765888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.766370 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.766799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.767483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:27.767962 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:27.768388 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:27.899160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:27.907467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-281df301-ef84-407b-aa61-645212781f55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1547 microversion: 2.1 time: 0.151670 Sep 19 15:02:27.908046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 854/964] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:27 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:29.456344 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beffba32-c49c-409d-b6d2-31fc9034a927"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:29.458696 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:29.465258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:29.466251 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:29.466690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:29.467395 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:29.467868 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:29.468298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:29.713455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-77a5c493-f12a-428d-ac4a-6f2ad561ecdf tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261090 Sep 19 15:02:29.714133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 855/965] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Sep 19 15:02:29 2022] POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:30.979366 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:02:30.980090 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:02:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 15:02:41.102723 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:02:41.103351 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 15:02:41.540108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell0:SELECT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:41.540952 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:41.541722 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:41.546456 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:41.547166 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:41.556938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:41.557499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:41.558149 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:41.559348 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:41.559841 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:41.560254 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:41.694819 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:41.703168 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f40ea007-eedb-4368-b485-48da53c77d6f tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1593 microversion: 2.1 time: 0.164630 Sep 19 15:02:41.703726 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 856/966] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:41 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:43.350332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-69049a0e-afad-4a9a-9633-0dbb8cafaddf req-ad582549-4551-43ee-9395-4c3b540c3749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:43.361657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-69049a0e-afad-4a9a-9633-0dbb8cafaddf req-ad582549-4551-43ee-9395-4c3b540c3749 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:43.361906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-69049a0e-afad-4a9a-9633-0dbb8cafaddf req-ad582549-4551-43ee-9395-4c3b540c3749 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:43.362297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-69049a0e-afad-4a9a-9633-0dbb8cafaddf req-ad582549-4551-43ee-9395-4c3b540c3749 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:43.378701 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-69049a0e-afad-4a9a-9633-0dbb8cafaddf req-ad582549-4551-43ee-9395-4c3b540c3749 service nova] Creating event network-changed:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:02:43.384688 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-69049a0e-afad-4a9a-9633-0dbb8cafaddf req-ad582549-4551-43ee-9395-4c3b540c3749 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037792 Sep 19 15:02:43.385290 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 857/967] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:44.415264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-774331224"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:44.416142 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:44.422501 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:44.423082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:44.423589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:44.424415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:44.424938 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:44.425436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:44.565112 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.network.security_group_api [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Adding security group 24e0013e-1625-4309-a66e-773490da0d3d to port e6448114-2a3b-495c-aeef-3f431ce05150 Sep 19 15:02:44.927347 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-dad80810-ecfe-402b-ace8-856a2c8aac69 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/action" status: 202 len: 0 microversion: 2.1 time: 0.516936 Sep 19 15:02:44.928237 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 858/968] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:44 2022] POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:02:44.936849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:44.937745 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:44.944550 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:44.945315 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:44.945926 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:44.946803 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:44.947419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:44.948056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:45.109998 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:45.118400 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b0e59bd5-01e9-4e30-b882-d9a0843b0676 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1758 microversion: 2.1 time: 0.185754 Sep 19 15:02:45.119036 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 859/969] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:44 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:45.401226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-f979c596-48e7-43c5-8827-6804d6a1d490 req-d6884da3-27a7-4375-93b3-f4879708e5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:45.410710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f979c596-48e7-43c5-8827-6804d6a1d490 req-d6884da3-27a7-4375-93b3-f4879708e5f7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:45.411297 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f979c596-48e7-43c5-8827-6804d6a1d490 req-d6884da3-27a7-4375-93b3-f4879708e5f7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:45.411801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-f979c596-48e7-43c5-8827-6804d6a1d490 req-d6884da3-27a7-4375-93b3-f4879708e5f7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:45.422899 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-f979c596-48e7-43c5-8827-6804d6a1d490 req-d6884da3-27a7-4375-93b3-f4879708e5f7 service nova] Creating event network-changed:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:02:45.427983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-f979c596-48e7-43c5-8827-6804d6a1d490 req-d6884da3-27a7-4375-93b3-f4879708e5f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030434 Sep 19 15:02:45.428691 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 860/970] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:02:52.435118 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:02:52.435702 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:02:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 15:02:58.060720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=10 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:58.061472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=20 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:02:58.066133 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.066724 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:58.074948 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.075448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.075913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.076661 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.077121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.077547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.103145 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:02:58.182490 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e892ec9b-1e58-4045-81d1-b1fb53fabd03 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "DELETE /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 204 len: 0 microversion: 2.1 time: 0.124318 Sep 19 15:02:58.182929 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 861/971] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 15:02:58 2022] DELETE /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:02:58.188564 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-568e53a4-c3c3-4a03-b850-e0938f0b3a8f req-31951930-c378-479d-b5e1-9d0000b9815b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cd8058-1e91-4ff3-90c1-93bb8106ddb8", "tag": "d0cba83a-0c6d-4b60-9927-84d66ee146d6"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:58.197966 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-568e53a4-c3c3-4a03-b850-e0938f0b3a8f req-31951930-c378-479d-b5e1-9d0000b9815b service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.198436 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-568e53a4-c3c3-4a03-b850-e0938f0b3a8f req-31951930-c378-479d-b5e1-9d0000b9815b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.198865 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-568e53a4-c3c3-4a03-b850-e0938f0b3a8f req-31951930-c378-479d-b5e1-9d0000b9815b service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.209801 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-568e53a4-c3c3-4a03-b850-e0938f0b3a8f req-31951930-c378-479d-b5e1-9d0000b9815b service nova] Creating event network-changed:d0cba83a-0c6d-4b60-9927-84d66ee146d6 for instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 on hv-cinder-75670 Sep 19 15:02:58.214595 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-568e53a4-c3c3-4a03-b850-e0938f0b3a8f req-31951930-c378-479d-b5e1-9d0000b9815b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030036 Sep 19 15:02:58.215913 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 862/972] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:02:58.220713 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:58.221419 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:58.227576 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.228090 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.228528 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.229220 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:58.229674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:58.230123 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:58.370641 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:58.379464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-94aa36ef-efa4-4b6a-a82a-9c3c06c6ba84 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1577 microversion: 2.1 time: 0.162585 Sep 19 15:02:58.380455 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 863/973] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:58 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:02:59.171426 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:02:59.173872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:59.180572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:59.181056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:59.181494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:59.182224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:59.182672 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:59.183371 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:59.265644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a1a68067-b3c0-44f5-a8d8-a79cbd1afda4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/action" status: 202 len: 0 microversion: 2.1 time: 0.098913 Sep 19 15:02:59.266943 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 864/974] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 15:02:59 2022] POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:02:59.274665 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:59.275434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:59.281866 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:59.282355 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:59.282794 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:59.283494 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:59.283977 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:59.284405 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:59.597907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:59.606298 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-621f26b7-608d-493e-adfc-9b345c0c143a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1750 microversion: 2.1 time: 0.335685 Sep 19 15:02:59.606950 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 865/975] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:59 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1750 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:02:59.626686 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:02:59.627289 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:02:59.633104 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:59.633582 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:59.634014 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:59.634710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:02:59.635154 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:02:59.635575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:02:59.948156 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:02:59.957659 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-d960eeed-e692-4d57-a0c6-361acb468b9c tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1577 microversion: 2.1 time: 0.334632 Sep 19 15:02:59.958286 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 866/976] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:02:59 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1577 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:00.236435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-32ff9a81-2d60-4630-b4c5-a7821b3e46b6 req-9d54d042-d504-4a21-a55c-2704e57d0430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cd8058-1e91-4ff3-90c1-93bb8106ddb8", "name": "network-vif-deleted", "tag": "d0cba83a-0c6d-4b60-9927-84d66ee146d6"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:00.246639 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-32ff9a81-2d60-4630-b4c5-a7821b3e46b6 req-9d54d042-d504-4a21-a55c-2704e57d0430 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.247118 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-32ff9a81-2d60-4630-b4c5-a7821b3e46b6 req-9d54d042-d504-4a21-a55c-2704e57d0430 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.247547 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-32ff9a81-2d60-4630-b4c5-a7821b3e46b6 req-9d54d042-d504-4a21-a55c-2704e57d0430 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:00.260226 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-32ff9a81-2d60-4630-b4c5-a7821b3e46b6 req-9d54d042-d504-4a21-a55c-2704e57d0430 service nova] Creating event network-vif-deleted:d0cba83a-0c6d-4b60-9927-84d66ee146d6 for instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 on hv-cinder-75670 Sep 19 15:03:00.265821 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-32ff9a81-2d60-4630-b4c5-a7821b3e46b6 req-9d54d042-d504-4a21-a55c-2704e57d0430 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033013 Sep 19 15:03:00.266751 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 867/977] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:03:00.630332 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:00.631137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:00.638451 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.638961 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.639399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:00.640345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.640720 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.641150 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:00.788415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:00.796743 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f53a24ef-1af6-42d0-8e0c-50edfeb59102 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.170818 Sep 19 15:03:00.797306 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 868/978] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:00 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:00.980632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:00.981240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:00.987427 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.987941 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.988372 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:00.989062 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:00.989508 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:00.989918 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.028219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.028766 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.029572 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.030105 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lazy-loading 'fault' on Instance uuid 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:01.085591 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:01.094262 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5097170d-21fc-49e3-852c-e9263eee76a1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 200 len: 1396 microversion: 2.1 time: 0.117469 Sep 19 15:03:01.094915 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 869/979] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:00 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 1396 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:01.819480 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:01.820181 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:01.826487 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.826968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.827401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.828128 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:01.828577 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:01.828999 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:01.971180 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:01.979267 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-2dae335f-ee85-4539-9f5f-5e0130c3c98e tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.163909 Sep 19 15:03:01.979851 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 870/980] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:01 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:02.119082 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:02.119609 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 83cd8058-1e91-4ff3-90c1-93bb8106ddb8] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:02.125574 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:02.126052 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:02.126483 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:02.127160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:02.127607 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:02.128056 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:02.141633 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] HTTP exception thrown: Instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 could not be found. Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Request method failure captured: Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 HTTP/1.1 Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKILk8os_wV2A--XhLR4eg4VZ6mQzL5yc_UwjYrreAv2F5YiSX9_970-dkUEL9YQXzp9bfU67X1HV4XnBtQYEdRx3zbEHSrW9hkEdN7UDtE24VxjZn3RXW1VYOaq3Qg_iqPDZu_ZWDNmitoIvUD_8GTBntna8D6Fhwkal32aStMfzzGA Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:03:02.143293 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbb13ea6de2a48e99ce93be06fd87830", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 52173f24f42a481380b047abe76bca57 Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 could not be found. Sep 19 15:03:02.145084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '83cd8058-1e91-4ff3-90c1-93bb8106ddb8'} Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 could not be found. Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:02.146003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 could not be found. Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 could not be found. Sep 19 15:03:02.147435 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:02.149117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Returning 404 to user: Instance 83cd8058-1e91-4ff3-90c1-93bb8106ddb8 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:02.149117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-12d5f97a-fa4c-427b-850a-f0d54564e4fb tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8" status: 404 len: 111 microversion: 2.1 time: 0.029622 Sep 19 15:03:02.149117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 871/981] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:02 2022] GET /compute/v2.1/servers/83cd8058-1e91-4ff3-90c1-93bb8106ddb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:03:03.002849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:03.003544 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:03.009965 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.010448 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.010888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.012271 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:03.012799 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:03.013323 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:03.155955 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:03.164115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-63c2ce9a-531c-4c44-a635-bac2a5f820fe tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.165188 Sep 19 15:03:03.164675 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 872/982] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:02 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:04.188287 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:04.188959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:04.195243 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:04.195729 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:04.196199 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:04.196897 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:04.197354 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:04.197784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:04.344610 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:04.352778 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-afd3f41f-8adb-489f-91f3-c221e9e8d346 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.169386 Sep 19 15:03:04.353322 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 873/983] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:04 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:05.376757 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:05.377434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:05.383909 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.384399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.384838 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.385538 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.386002 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.386432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.546079 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:05.554256 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-691f4721-fc26-43a2-94c4-fadd55c219e6 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.181448 Sep 19 15:03:05.554829 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 874/984] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:05 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:05.560127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:05.560613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:05.566303 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.566784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.567219 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.567930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.568379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.568798 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.594438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:03:05.620739 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:05.673930 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-286c85d5-c513-454f-9774-e51ab5ba7e04 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 204 len: 0 microversion: 2.1 time: 0.117885 Sep 19 15:03:05.674517 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 875/985] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 15:03:05 2022] DELETE /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 15:03:05.681543 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-8f2b00d9-a6df-4e09-b323-0d005edfc710 req-0c4de78e-ecca-486d-a295-9fda68af97b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b2c21d-ef12-47b1-8ac7-43a6eb30d996", "tag": "e9e7dc81-3f4f-4517-bb50-4f763916413d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:05.692524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8f2b00d9-a6df-4e09-b323-0d005edfc710 req-0c4de78e-ecca-486d-a295-9fda68af97b7 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.692992 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8f2b00d9-a6df-4e09-b323-0d005edfc710 req-0c4de78e-ecca-486d-a295-9fda68af97b7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.694240 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-8f2b00d9-a6df-4e09-b323-0d005edfc710 req-0c4de78e-ecca-486d-a295-9fda68af97b7 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.707080 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-8f2b00d9-a6df-4e09-b323-0d005edfc710 req-0c4de78e-ecca-486d-a295-9fda68af97b7 service nova] Creating event network-changed:e9e7dc81-3f4f-4517-bb50-4f763916413d for instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 on hv-cinder-75670 Sep 19 15:03:05.711983 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-8f2b00d9-a6df-4e09-b323-0d005edfc710 req-0c4de78e-ecca-486d-a295-9fda68af97b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036143 Sep 19 15:03:05.712589 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 876/986] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:05.718383 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:05.719084 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:05.725363 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.725846 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.726285 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.726979 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:05.727438 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:05.727877 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:05.865030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:05.873845 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f5342008-e97d-4fed-9a40-9f95fe4be063 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1577 microversion: 2.1 time: 0.160045 Sep 19 15:03:05.874422 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 877/987] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:05 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:06.577776 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:06.578423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:06.585131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:06.585488 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:06.585931 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:06.586614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:06.587060 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:06.587476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:06.778067 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:06.786425 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6fcc3fa5-a6f0-48f5-a989-53f2335fae2a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.212542 Sep 19 15:03:06.786993 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 878/988] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:06 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:06.897406 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:06.898022 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:06.904666 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:06.905152 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:06.905586 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:06.906282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:06.906728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:06.907153 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:07.076566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:07.085752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-b70d4a40-9944-4b58-9853-bd1d673466d6 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1577 microversion: 2.1 time: 0.191241 Sep 19 15:03:07.085752 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 879/989] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:06 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:07.811674 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:07.812401 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:07.818614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:07.819094 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:07.819536 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:07.820232 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:07.820683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:07.821100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:08.088473 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:08.098862 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-45fc3085-e334-4f1a-8ff5-c81e53a7fc9b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.291859 Sep 19 15:03:08.099415 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 880/990] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:07 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:08.165059 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-6c99e210-43ac-4d58-9003-a89692a00db0 req-99840b21-9f27-445a-bb90-4cf2c5165895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b2c21d-ef12-47b1-8ac7-43a6eb30d996", "name": "network-vif-deleted", "tag": "e9e7dc81-3f4f-4517-bb50-4f763916413d"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:08.175003 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6c99e210-43ac-4d58-9003-a89692a00db0 req-99840b21-9f27-445a-bb90-4cf2c5165895 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:08.175477 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6c99e210-43ac-4d58-9003-a89692a00db0 req-99840b21-9f27-445a-bb90-4cf2c5165895 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:08.175934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-6c99e210-43ac-4d58-9003-a89692a00db0 req-99840b21-9f27-445a-bb90-4cf2c5165895 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:08.187570 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-6c99e210-43ac-4d58-9003-a89692a00db0 req-99840b21-9f27-445a-bb90-4cf2c5165895 service nova] Creating event network-vif-deleted:e9e7dc81-3f4f-4517-bb50-4f763916413d for instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 on hv-cinder-75670 Sep 19 15:03:08.192507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-6c99e210-43ac-4d58-9003-a89692a00db0 req-99840b21-9f27-445a-bb90-4cf2c5165895 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091863 Sep 19 15:03:08.193157 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 881/991] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:08.198305 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:08.199029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:08.205206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:08.205689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:08.206132 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:08.206959 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:08.207279 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:08.207706 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:08.269507 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52173f24f42a481380b047abe76bca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb13ea6de2a48e99ce93be06fd87830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:08.277667 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fac00077-7b8d-4a6c-bc3e-dfc24bcaf095 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 200 len: 1225 microversion: 2.1 time: 0.083286 Sep 19 15:03:08.278245 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 882/992] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:08 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:09.122614 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.123236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.129689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.130174 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.130627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.131309 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.131764 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.132218 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.273476 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:09.284669 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-ac6f8a4d-d44a-4f38-bc48-6f39023721cb tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.165622 Sep 19 15:03:09.285592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 883/993] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:09 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:09.300264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.300867 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: c8b2c21d-ef12-47b1-8ac7-43a6eb30d996] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.306746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.307224 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.307655 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.308683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.309131 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.309549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.322937 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] HTTP exception thrown: Instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 could not be found. Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Request method failure captured: Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 HTTP/1.1 Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKILk8os_wV2A--XhLR4eg4VZ6mQzL5yc_UwjYrreAv2F5YiSX9_970-dkUEL9YQXzp9bfU67X1HV4XnBtQYEdRx3zbEHSrW9hkEdN7UDtE24VxjZn3RXW1VYOaq3Qg_iqPDZu_ZWDNmitoIvUD_8GTBntna8D6Fhwkal32aStMfzzGA Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:03:09.324660 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbb13ea6de2a48e99ce93be06fd87830", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 52173f24f42a481380b047abe76bca57 Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 could not be found. Sep 19 15:03:09.326171 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': 'c8b2c21d-ef12-47b1-8ac7-43a6eb30d996'} Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 could not be found. Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:09.327085 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 could not be found. Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 could not be found. Sep 19 15:03:09.328689 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.330235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Returning 404 to user: Instance c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:09.330235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3e3452d9-04f7-4099-b6f9-735ca5762cf1 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996" status: 404 len: 111 microversion: 2.1 time: 0.029866 Sep 19 15:03:09.330235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 884/994] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:09 2022] GET /compute/v2.1/servers/c8b2c21d-ef12-47b1-8ac7-43a6eb30d996 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:03:09.776117 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.776622 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.783140 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.783625 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.784499 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.785209 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.785671 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.786098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.799471 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] HTTP exception thrown: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Request method failure captured: Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 HTTP/1.1 Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKILk8os_wV2A--XhLR4eg4VZ6mQzL5yc_UwjYrreAv2F5YiSX9_970-dkUEL9YQXzp9bfU67X1HV4XnBtQYEdRx3zbEHSrW9hkEdN7UDtE24VxjZn3RXW1VYOaq3Qg_iqPDZu_ZWDNmitoIvUD_8GTBntna8D6Fhwkal32aStMfzzGA Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:03:09.801054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbb13ea6de2a48e99ce93be06fd87830", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 52173f24f42a481380b047abe76bca57 Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.802784 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '15e15404-48df-4490-8dc2-f0f5308f06f7'} Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:09.803657 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.805115 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.806498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Returning 404 to user: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:09.806498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-243fd70d-e543-4054-982f-42977ed9c407 tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 404 len: 111 microversion: 2.1 time: 0.030250 Sep 19 15:03:09.806498 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 885/995] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 15:03:09 2022] DELETE /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:03:09.811134 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:09.811788 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] [instance: 15e15404-48df-4490-8dc2-f0f5308f06f7] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:09.817549 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.818016 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.818445 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.819127 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:09.819575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:09.820021 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:09.833575 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] HTTP exception thrown: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Request method failure captured: Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 HTTP/1.1 Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKILk8os_wV2A--XhLR4eg4VZ6mQzL5yc_UwjYrreAv2F5YiSX9_970-dkUEL9YQXzp9bfU67X1HV4XnBtQYEdRx3zbEHSrW9hkEdN7UDtE24VxjZn3RXW1VYOaq3Qg_iqPDZu_ZWDNmitoIvUD_8GTBntna8D6Fhwkal32aStMfzzGA Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:03:09.835081 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbb13ea6de2a48e99ce93be06fd87830", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbb13ea6de2a48e99ce93be06fd87830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: cbb13ea6de2a48e99ce93be06fd87830 Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestVolumeBootPattern-344033396 Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: 52173f24f42a481380b047abe76bca57 Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestVolumeBootPattern-344033396-project Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.836807 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '15e15404-48df-4490-8dc2-f0f5308f06f7'} Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:09.837630 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. Sep 19 15:03:09.838924 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:09.840690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Returning 404 to user: Instance 15e15404-48df-4490-8dc2-f0f5308f06f7 could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:09.840690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-e86193f8-0d0b-418f-9428-f34f5774f4df tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7" status: 404 len: 111 microversion: 2.1 time: 0.029233 Sep 19 15:03:09.840690 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 886/996] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:09 2022] GET /compute/v2.1/servers/15e15404-48df-4490-8dc2-f0f5308f06f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:03:10.309542 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:10.310227 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:10.316567 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.317078 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.317524 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:10.318222 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:10.318677 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:10.319109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:10.463236 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:10.471434 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-aef5aed2-b4ac-41a0-a70e-21e08881da64 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1755 microversion: 2.1 time: 0.166651 Sep 19 15:03:10.472029 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 887/997] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:10 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:11.149831 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-aa5c9156-e54c-49a4-85d2-323052a98f4a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] Calling method '.version_select at 0x7f9f3b166c10>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:11.173733 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-aa5c9156-e54c-49a4-85d2-323052a98f4a tempest-TestVolumeBootPattern-344033396 tempest-TestVolumeBootPattern-344033396-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-579270075" status: 202 len: 0 microversion: 2.1 time: 0.027681 Sep 19 15:03:11.174330 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 888/998] 10.222.0.60 () {58 vars in 1260 bytes} [Mon Sep 19 15:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-579270075 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:03:11.496636 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:11.497328 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:11.503919 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:11.504472 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:11.504907 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:11.505599 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:11.506046 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:11.506465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:11.753314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:11.761849 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-a735f54f-583d-4788-bfb1-f888f6050a9a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1758 microversion: 2.1 time: 0.270103 Sep 19 15:03:11.762417 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 889/999] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:11 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1758 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:44.032465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-774331224"}} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:44.033360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:44.035413 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:44.036109 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG dbcounter [-] [126870] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=126870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 15:03:44.041900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.042399 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.042836 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.043540 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.044032 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.044467 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.178258 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.network.security_group_api [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Removing security group 24e0013e-1625-4309-a66e-773490da0d3d from port e6448114-2a3b-495c-aeef-3f431ce05150 Sep 19 15:03:44.481895 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-44b7d61c-17c1-4133-a35a-ee19d4d6610b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/action" status: 202 len: 0 microversion: 2.1 time: 0.453867 Sep 19 15:03:44.482592 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 890/1000] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Sep 19 15:03:44 2022] POST /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:03:44.491710 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-aceda51c-8416-4c4f-a3df-e7d1d2fa0743 req-8a5c268c-bfd6-421c-adc4-6058aeabddad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:44.502054 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-aceda51c-8416-4c4f-a3df-e7d1d2fa0743 req-8a5c268c-bfd6-421c-adc4-6058aeabddad service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:44.502632 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-aceda51c-8416-4c4f-a3df-e7d1d2fa0743 req-8a5c268c-bfd6-421c-adc4-6058aeabddad service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:44.503194 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-aceda51c-8416-4c4f-a3df-e7d1d2fa0743 req-8a5c268c-bfd6-421c-adc4-6058aeabddad service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:44.514939 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-aceda51c-8416-4c4f-a3df-e7d1d2fa0743 req-8a5c268c-bfd6-421c-adc4-6058aeabddad service nova] Creating event network-changed:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:03:44.520357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-aceda51c-8416-4c4f-a3df-e7d1d2fa0743 req-8a5c268c-bfd6-421c-adc4-6058aeabddad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032732 Sep 19 15:03:44.521377 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 891/1001] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:45.691432 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:45.692108 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:45.698314 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.698900 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.699276 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.699985 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.700443 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.700878 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.783912 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lazy-loading 'services' on Instance uuid 5ba96567-9056-43a1-8149-bda2bd1dd1fd {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:45.862940 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-bf43f9a6-8a97-4fc8-b598-7bbb7e2abb55 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments/beffba32-c49c-409d-b6d2-31fc9034a927" status: 202 len: 0 microversion: 2.1 time: 0.176809 Sep 19 15:03:45.863555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 892/1002] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 15:03:45 2022] DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments/beffba32-c49c-409d-b6d2-31fc9034a927 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:03:45.869596 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-cc7d15e1-8a2d-4596-84af-066bfed88feb req-d9d49f1a-b5e5-428d-bdbf-dfdf59c1f896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:45.880100 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cc7d15e1-8a2d-4596-84af-066bfed88feb req-d9d49f1a-b5e5-428d-bdbf-dfdf59c1f896 service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.880565 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cc7d15e1-8a2d-4596-84af-066bfed88feb req-d9d49f1a-b5e5-428d-bdbf-dfdf59c1f896 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.881211 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-cc7d15e1-8a2d-4596-84af-066bfed88feb req-d9d49f1a-b5e5-428d-bdbf-dfdf59c1f896 service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.894882 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-cc7d15e1-8a2d-4596-84af-066bfed88feb req-d9d49f1a-b5e5-428d-bdbf-dfdf59c1f896 service nova] Creating event network-changed:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:03:45.900282 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-cc7d15e1-8a2d-4596-84af-066bfed88feb req-d9d49f1a-b5e5-428d-bdbf-dfdf59c1f896 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035178 Sep 19 15:03:45.900887 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 893/1003] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:45.909343 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:45.911863 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:45.918566 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.919069 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.919700 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.920995 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:45.922525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:45.922968 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:45.960030 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-f20fe388-ac98-4581-b32e-abc27e8b16fa tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056873 Sep 19 15:03:45.960746 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 894/1004] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 15:03:45 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 15:03:46.973934 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:46.976360 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:46.983018 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:46.983495 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:46.983957 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:46.984644 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:46.985095 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:46.985509 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:47.013872 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6955085d-0cf8-4e0d-8bea-a154a8258bf4 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044175 Sep 19 15:03:47.014423 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 895/1005] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Sep 19 15:03:46 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 15:03:47.025011 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:47.025489 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:47.031785 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:47.032299 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:47.032728 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:47.033516 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:47.033960 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:47.034379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:47.109397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] HTTP exception thrown: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd is not attached to volume beffba32-c49c-409d-b6d2-31fc9034a927 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Request method failure captured: Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments/beffba32-c49c-409d-b6d2-31fc9034a927 HTTP/1.1 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIRg7UiSiC0gnkvVUrUoMoSbLi5PRMH6N7Yoh6hd2uimBpq-BcJxjclJCMuxYcPg-0U-a_fI09QbykKXBSNTQ6Uxk9lEvs0qGL-epp7a0KIm-e7gPRpkZuaITz-AMC4YX0Or3gpO4H0XoIghnklB0hnMEZ6urlhPPIdkAhCb-Knee_w Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 5fca221e257f44dea6b74f7737978739 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestMinimumBasicScenario-963574012 Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:03:47.111735 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5fca221e257f44dea6b74f7737978739", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5fca221e257f44dea6b74f7737978739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5fca221e257f44dea6b74f7737978739"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5fca221e257f44dea6b74f7737978739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestMinimumBasicScenario-963574012 Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 5fca221e257f44dea6b74f7737978739 Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestMinimumBasicScenario-963574012 Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestMinimumBasicScenario-963574012-project Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: a3d7fd2980ce48a49931642b01bab212 Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestMinimumBasicScenario-963574012-project Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:03:47.113394 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd is not attached to volume beffba32-c49c-409d-b6d2-31fc9034a927 Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'server_id': '5ba96567-9056-43a1-8149-bda2bd1dd1fd', 'id': 'beffba32-c49c-409d-b6d2-31fc9034a927'} Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id beffba32-c49c-409d-b6d2-31fc9034a927. Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:47.114613 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd is not attached to volume beffba32-c49c-409d-b6d2-31fc9034a927 Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd is not attached to volume beffba32-c49c-409d-b6d2-31fc9034a927 Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:47.116338 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Returning 404 to user: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd is not attached to volume beffba32-c49c-409d-b6d2-31fc9034a927 {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:47.117716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-fb6641b7-196e-4ea1-9550-8f47aec8f32a tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments/beffba32-c49c-409d-b6d2-31fc9034a927" status: 404 len: 154 microversion: 2.1 time: 0.091817 Sep 19 15:03:47.117716 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 896/1006] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Sep 19 15:03:47 2022] DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd/os-volume_attachments/beffba32-c49c-409d-b6d2-31fc9034a927 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:03:48.257288 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:48.257916 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:48.264106 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:48.264583 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:48.265015 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:48.265703 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:48.266136 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:48.266555 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:48.291300 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Going to try to terminate instance {{(pid=126870) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 15:03:48.367092 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-8abef807-652c-4f63-a45d-185ce87cd849 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 204 len: 0 microversion: 2.1 time: 0.113340 Sep 19 15:03:48.367676 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 897/1007] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Sep 19 15:03:48 2022] DELETE /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 15:03:48.376704 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:48.377397 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:48.383379 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:48.383888 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:48.384327 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:48.385012 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:48.385464 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:48.385925 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:48.532160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:48.539847 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-3d355b69-d706-4b57-b4a9-8955fef759be tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1553 microversion: 2.1 time: 0.167275 Sep 19 15:03:48.540408 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 898/1008] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:48 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 15:03:49.563502 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:49.564235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:49.570650 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:49.571137 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:49.571578 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:49.572312 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:49.572771 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:49.573197 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:49.699357 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:49.707212 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-6d284af8-5dde-4503-a71b-38ce631bf5b7 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1553 microversion: 2.1 time: 0.147966 Sep 19 15:03:49.707777 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 899/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:49 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:50.489883 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [req-5db45ae1-b34d-4a95-a7cc-d61aef4c8e7a req-21f51c14-9a62-4696-966d-81a3491922da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba96567-9056-43a1-8149-bda2bd1dd1fd", "name": "network-vif-deleted", "tag": "e6448114-2a3b-495c-aeef-3f431ce05150"}]} {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 15:03:50.500412 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5db45ae1-b34d-4a95-a7cc-d61aef4c8e7a req-21f51c14-9a62-4696-966d-81a3491922da service nova] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:50.500973 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5db45ae1-b34d-4a95-a7cc-d61aef4c8e7a req-21f51c14-9a62-4696-966d-81a3491922da service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:50.501465 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [req-5db45ae1-b34d-4a95-a7cc-d61aef4c8e7a req-21f51c14-9a62-4696-966d-81a3491922da service nova] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:50.512621 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.compute.server_external_events [req-5db45ae1-b34d-4a95-a7cc-d61aef4c8e7a req-21f51c14-9a62-4696-966d-81a3491922da service nova] Creating event network-vif-deleted:e6448114-2a3b-495c-aeef-3f431ce05150 for instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd on hv-cinder-75670 Sep 19 15:03:50.518020 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [req-5db45ae1-b34d-4a95-a7cc-d61aef4c8e7a req-21f51c14-9a62-4696-966d-81a3491922da service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Sep 19 15:03:50.518623 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 900/1010] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Sep 19 15:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 15:03:50.734277 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:50.734927 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:50.741396 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:50.741906 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:50.742345 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:50.743041 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:50.743496 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:50.743976 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:50.777683 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:50.778160 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:50.778588 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:50.779034 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.objects.instance [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lazy-loading 'fault' on Instance uuid 5ba96567-9056-43a1-8149-bda2bd1dd1fd {{(pid=126870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 15:03:50.822264 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.policy [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d7fd2980ce48a49931642b01bab212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca221e257f44dea6b74f7737978739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126870) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 15:03:50.830235 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-182fa41b-2205-4fbd-822f-9bd3ff535c2b tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 200 len: 1347 microversion: 2.1 time: 0.101233 Sep 19 15:03:50.830818 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 901/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:50 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 15:03:51.853506 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:51.854208 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.compute.api [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] [instance: 5ba96567-9056-43a1-8149-bda2bd1dd1fd] Fetching instance by UUID {{(pid=126870) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 15:03:51.860627 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:51.861098 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:51.861525 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:51.862206 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Acquiring lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 15:03:51.862652 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 15:03:51.863071 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG oslo_concurrency.lockutils [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Lock "9fa6516d-d8a6-4e2a-89af-a6c10f9bd626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 15:03:51.876600 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.wsgi [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] HTTP exception thrown: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd could not be found. Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Request method failure captured: Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: request: GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd HTTP/1.1 Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept: application/json Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Accept-Encoding: identity Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Connection: close Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Length: 0 Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Content-Type: application/json Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Host: 10.222.0.60 Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: Openstack-System-Scope: None Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: User-Agent: python-urllib3/1.26.12 Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Auth-Token: gAAAAABjKIRg7UiSiC0gnkvVUrUoMoSbLi5PRMH6N7Yoh6hd2uimBpq-BcJxjclJCMuxYcPg-0U-a_fI09QbykKXBSNTQ6Uxk9lEvs0qGL-epp7a0KIm-e7gPRpkZuaITz-AMC4YX0Or3gpO4H0XoIghnklB0hnMEZ6urlhPPIdkAhCb-Knee_w Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Id: None Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Domain-Name: None Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Identity-Status: Confirmed Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Is-Admin-Project: True Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Id: default Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Domain-Name: Default Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Id: 5fca221e257f44dea6b74f7737978739 Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Project-Name: tempest-TestMinimumBasicScenario-963574012 Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Role: member,reader Sep 19 15:03:51.878244 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Roles: member,reader Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5fca221e257f44dea6b74f7737978739", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5fca221e257f44dea6b74f7737978739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5fca221e257f44dea6b74f7737978739"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5fca221e257f44dea6b74f7737978739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}] Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant: tempest-TestMinimumBasicScenario-963574012 Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Id: 5fca221e257f44dea6b74f7737978739 Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-Tenant-Name: tempest-TestMinimumBasicScenario-963574012 Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User: tempest-TestMinimumBasicScenario-963574012-project Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Id: default Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Domain-Name: Default Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Id: a3d7fd2980ce48a49931642b01bab212 Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: X-User-Name: tempest-TestMinimumBasicScenario-963574012-project Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: method: > Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: exception: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd could not be found. Sep 19 15:03:51.879982 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: action_args: {'id': '5ba96567-9056-43a1-8149-bda2bd1dd1fd'} Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd could not be found. Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 15:03:51.880936 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd could not be found. Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd could not be found. Sep 19 15:03:51.882375 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: ERROR nova.api.openstack.wsgi Sep 19 15:03:51.883647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Returning 404 to user: Instance 5ba96567-9056-43a1-8149-bda2bd1dd1fd could not be found. {{(pid=126870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 15:03:51.883647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-5321bd80-af90-4035-85de-ee4b60c5b293 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd" status: 404 len: 111 microversion: 2.1 time: 0.030073 Sep 19 15:03:51.883647 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 902/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Sep 19 15:03:51 2022] GET /compute/v2.1/servers/5ba96567-9056-43a1-8149-bda2bd1dd1fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 15:03:51.889121 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: DEBUG nova.api.openstack.wsgi [None req-9d5a5422-54d0-47b9-a810-adff81a7e169 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] Calling method '.version_select at 0x7f9f39b52c10>' {{(pid=126870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 15:03:51.908416 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: INFO nova.api.openstack.requestlog [None req-9d5a5422-54d0-47b9-a810-adff81a7e169 tempest-TestMinimumBasicScenario-963574012 tempest-TestMinimumBasicScenario-963574012-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-775843559" status: 202 len: 0 microversion: 2.1 time: 0.022951 Sep 19 15:03:51.908991 dv-cinder-756709-7-iscsi devstack@n-api.service[126870]: [pid: 126870|app: 0|req: 903/1013] 10.222.0.60 () {58 vars in 1269 bytes} [Mon Sep 19 15:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-775843559 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 15:05:50.992598 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:05:50.993261 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:05:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 15:06:01.117050 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:06:01.117641 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 15:06:12.452108 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:06:12.452766 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:06:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Sep 19 15:09:11.009640 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 15:09:11.010360 dv-cinder-756709-7-iscsi devstack@n-api.service[126869]: Mon Sep 19 15:09:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!!